-- Logs begin at Mon 2022-05-16 17:40:53 UTC, end at Mon 2022-05-16 19:06:46 UTC. -- May 16 18:33:46.532627 dv-cinder-750782-22-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 16 18:33:46.540811 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 16 18:33:46.543394 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 18:33:46 2022] *** May 16 18:33:46.543539 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 18:33:46.543655 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 18:33:46.543774 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: nodename: dv-cinder-750782-22-iscsi May 16 18:33:46.543864 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: machine: x86_64 May 16 18:33:46.543961 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: clock source: unix May 16 18:33:46.544061 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: pcre jit disabled May 16 18:33:46.544165 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: detected number of CPU cores: 4 May 16 18:33:46.544352 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: current working directory: / May 16 18:33:46.544518 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: detected binary path: /usr/bin/uwsgi-core May 16 18:33:46.544662 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: your processes number limit is 47680 May 16 18:33:46.544767 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: your memory page size is 4096 bytes May 16 18:33:46.544869 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: detected max file descriptor number: 2048 May 16 18:33:46.544995 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: lock engine: pthread robust mutexes May 16 18:33:46.545322 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: thunder lock: enabled May 16 18:33:46.545616 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 16 18:33:46.545920 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 18:33:46.592111 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: Python main interpreter initialized at 0x55a0d33159c0 May 16 18:33:46.592111 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: python threads support enabled May 16 18:33:46.592111 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: your server socket listen backlog is limited to 100 connections May 16 18:33:46.592111 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: your mercy for graceful operations on workers is 90 seconds May 16 18:33:46.592486 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: mapped 403077 bytes (393 KB) for 2 cores May 16 18:33:46.592550 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: *** Operational MODE: preforking *** May 16 18:33:46.592918 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: *** uWSGI is running in multiple interpreter mode *** May 16 18:33:46.592918 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: spawned uWSGI master process (pid: 91813) May 16 18:33:46.593378 dv-cinder-750782-22-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 16 18:33:46.595746 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: spawned uWSGI worker 1 (pid: 91825, cores: 1) May 16 18:33:46.595746 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: spawned uWSGI worker 2 (pid: 91826, cores: 1) May 16 18:33:46.595746 dv-cinder-750782-22-iscsi devstack@keystone.service[91813]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 18:33:52.414660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:33:52.414660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: from cryptography.utils import int_from_bytes May 16 18:33:52.415457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:33:52.415457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: from cryptography.utils import int_from_bytes May 16 18:33:52.416125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:33:52.416125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: from cryptography.utils import int_from_bytes May 16 18:33:52.416275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 18:33:52.416275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: from cryptography.utils import int_from_bytes May 16 18:33:52.465826 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 18:33:52.466049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 18:33:52.466049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 18:33:52.466247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 18:33:52.466319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] command line args: [] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 18:33:52.466384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] command line args: [] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 18:33:52.466770 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 18:33:52.466860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 18:33:52.466927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ================================================================================ {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 18:33:52.466992 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ================================================================================ {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 18:33:52.467061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] admin_token = **** {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.467121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] admin_token = **** {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.467177 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] config_dir = [] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.467233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] config_dir = [] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.467288 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.467515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.467605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] config_source = [] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.467672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] config_source = [] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.467764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] debug = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.467926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.468102 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] debug = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.468102 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.468612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.468757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.469842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.469842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.469842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] list_limit = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.469842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] log_config_append = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.469842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.470132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.470191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] log_dir = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.470191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] log_file = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.470299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.470361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.470588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.470739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.470875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.471011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.471148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.471278 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.471412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.471546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] list_limit = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.471674 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.471916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.472047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] log_config_append = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.472173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.472323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.472458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.472586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] log_dir = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.472720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.472720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.472973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] log_file = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.473106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.473233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.473365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.473526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.473657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.473914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.474071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.474221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] publish_errors = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.474355 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.474489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.474620 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.474747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.474875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.475020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.475150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.475277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.475404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.475536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.475672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] standard_threads = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.475847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.475982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.476110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.476236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.476367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.476507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.476507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] use_journal = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.476753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.476886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] use_json = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.477019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.477210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] use_stderr = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.477210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] use_syslog = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.477471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.477600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.477736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.477870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.477870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.478133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.478268 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.478402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] publish_errors = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.478537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.478672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.478801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.478943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.479073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.479200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.479334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.479478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.479607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.479763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.479906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.480044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] standard_threads = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.480180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.480308 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.480440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.480574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.480574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.480825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.480960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] use_journal = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.481088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.481215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] use_json = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.481356 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.481484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] use_stderr = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.481796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.481973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] use_syslog = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.482136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.482304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 18:33:52.482434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.482621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.482769 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.482900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.483032 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.483160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.483287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.483424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.483559 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.483696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.483888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.484018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.484151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.484279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.484414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.484542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.484542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.484787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.484921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.485055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.485055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.485323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.485451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.485584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.485712 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.485838 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.485977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.486112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.486239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.486366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.486493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.486619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.486757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.486885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.487022 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.487155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.487283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.487410 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.487546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.487674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.488189 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.488337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.488465 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.488599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.488799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.488799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.489041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.489168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.489304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.489431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.489566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.489701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.489828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.489960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.490098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.490227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.490365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.490494 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.490620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.490620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.490620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.490620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.491369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.491498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.491631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.491803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.492102 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.492251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.492382 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.492509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.492636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.492763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.492896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.493033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.493162 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.493301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.493429 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.493561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.493689 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.493825 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.493953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.494085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.494213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.494340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.494467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.494602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.494731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.494731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.494731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.494731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.494731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.495362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.495503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.495503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.495879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.496014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.496142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.496281 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.496281 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.496530 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.496659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.496800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.496934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.496934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.497711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.497916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.498113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.498249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.498249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.498501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.498630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.498630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.498880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.499008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.499008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.499264 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.499393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.499393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.499651 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.499828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.499828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.500070 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.500214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.500345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.500472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.500600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.500732 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.500866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.501013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.501143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.501271 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.501405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.501535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.501663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.501801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.501931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.502059 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.502197 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.502326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.502453 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.502580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.502783 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.502924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.503052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.503198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.503412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.503574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.503731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.503867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.503995 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.504123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.504123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.504373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.504503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.504637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.504776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.504911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.505040 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.505176 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.505304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.505432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.505559 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.505687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.505814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.505814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] auth.external = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.506073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.506212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.506341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.506341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.506604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.506604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.506847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.506984 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] auth.password = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.507112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.507240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] auth.token = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.507367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.507495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.507622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.507805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.507940 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.508075 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.508203 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.508331 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.508467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.508605 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.508734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.508861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.508989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.509117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.509244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.509379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] credential.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.509508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.509635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.509762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.509896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.510033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.510173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.510327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.510472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.510601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.510735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.510868 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.510996 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.511125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.511125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.511375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.511504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.511631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.511779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.511912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.512062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.512193 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.512323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.512457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.512586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.512715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.513401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.513544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.513688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.513819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.513948 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] auth.external = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.514085 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.514223 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.514352 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] federation.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.514497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.514635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.514765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.514901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.515040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] auth.password = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.515168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.515305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] auth.token = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.515435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.515564 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.515736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.515876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.516004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.516133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.516343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.516343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.516616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.516747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.516876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.517006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.517135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.517263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.517401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.517531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.517660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] credential.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.517788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.517916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.518045 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.518191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.518321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.518452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.518581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.518709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.518838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.519046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.519178 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.519307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.519436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.519566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.519694 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.519886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.520028 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.520158 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.520287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.520416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.520545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.520545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.520807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.520939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.521069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.521197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.521333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.521471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.521602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.521731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.521873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.522080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.522221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] federation.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.522360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.522489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.522619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.522748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.522877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.523006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.523146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.523276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.523405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.523541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.523682 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.523872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.524004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.524133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.524261 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.524390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.524518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.524654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.524786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.524915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.525043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.525171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.525305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.525443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.525582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.525757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.525893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.526022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.526151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.526288 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.526419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.526548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.526677 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.526806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.526935 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.527072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.527203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.527386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.527521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.527651 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.527803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.527945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.528076 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.528205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.528333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.528488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.528620 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.528758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.528888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.529018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.529147 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.529286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.529414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.529551 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.529681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.529808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.529937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.530067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.530196 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.530196 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.530454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.530584 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.530712 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.530850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.530987 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.531125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.531255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.531383 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.531511 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.531640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.531843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.531987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.532119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.532247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.532376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.532505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.532634 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.532770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.532914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.533043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.533173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.533301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.533430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.533566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.533696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.533824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.533953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.534082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.534211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.534457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.534607 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.534739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.534880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.535009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.535138 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.535276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.535406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.535534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.535662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.535873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.536003 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.536143 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.536275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.536404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.536533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.536672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.536801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.536938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.537068 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.537197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.537327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.537456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.537584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.537720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.537850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.537979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.538107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.538236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.538366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.538512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.538641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.538770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.538899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.539028 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.539165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.539295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.539424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.539559 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.539689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.539851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.539992 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.540123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.540252 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.540391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.540521 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.540656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.540804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.540936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.541064 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.541193 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] resource.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.541328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.541458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.541596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.541726 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.541855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.541984 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.542126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.542256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.542392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.542524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.542654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.542823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.542953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.543081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.543218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.543348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.543478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.543608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.543755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.543890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] role.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.544153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.544294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] role.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.544425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.544553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.544793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.544941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.545143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.545276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.545406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.559009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.559231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.559372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.559520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.560149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.560302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.560433 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.560563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.560692 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.560883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.561019 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.561150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.561279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.561408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.561539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.561676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.561807 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.561936 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.562075 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.562205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.562334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.562470 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.562470 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.562723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.562853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.562981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.563109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.563249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.563381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.563517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.563652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] resource.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.563819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.563950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.564095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.564287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.564466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.564621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.564767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.564923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.565069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.565211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.565350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.565490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.565631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.565782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.565938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.566079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.566218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.566357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.566496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.566645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] role.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.566788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.566927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] role.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.567067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.567206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.567343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.567343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.567617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.567786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.567955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.568098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] token.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.568237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.568385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.568525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.568665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.568806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.568946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.569087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.569235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.569376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.569516 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.569516 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.569792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.569934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.570082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.570223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.570363 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.570503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.570642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.570782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.570930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.571078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.571219 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.571358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.571358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.571630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.571815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.571962 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.572102 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.572242 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.572381 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.572520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.572668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.572808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.572947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.connection = **** {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.573096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.573246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.573386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.573386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.573668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.573668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.574059 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.574243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.574389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.574529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.574678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.574818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.574958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.575098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.575236 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.576027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.576195 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.576349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.576504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.576669 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.576809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.576948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.577096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.577238 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.577376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.577514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.577653 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.577791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.577939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] token.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.578087 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.578228 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.578376 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.578515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.578654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.578802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.578943 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.579082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.579221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 18:33:52.579362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.579362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.579362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.579362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.579362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.579362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.579362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.579362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.579362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.580542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.580542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.580542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.580542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.580542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.connection = **** {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.580542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.580542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.580542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.580542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.581688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.581688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.581688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.581688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.581688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.581688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.581688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.581688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.581688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.582913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.582913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.582913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.582913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.582913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 18:33:52.582913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 18:33:52.584744 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.584979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.585205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.587926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.588165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.588395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.594696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.597620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.623926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.624226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.625024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.625259 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.678220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.678501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.731254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.731618 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.732405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.732641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.800095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.800284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.800370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.800472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.800553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.800628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.800744 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.800835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.800961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.801050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.801175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.801268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.824882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.825114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.825294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.825388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.825535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.825629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.825750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.825851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.825972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.826061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.826179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.826267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.826404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.826597 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.837569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.837916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.852461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.852637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.852724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.852801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.852942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.853035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.853111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.853196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.853333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.853425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.853540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.853630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.853715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.853792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91825) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 18:33:52.871694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.871931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 18:33:52.872029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.872204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 18:33:52.872835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.873000 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 18:33:52.873214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.873412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 18:33:52.873501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.873678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.873810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.873937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.874062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.874189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.874340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.874467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.885203 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.885391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.885529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.885660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.885802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.885929 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.886059 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.886186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.894411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.894575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.897772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.898012 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.898149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.898276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.898416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.898545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.898696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.898936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.899070 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.899218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.899361 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.899500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.899627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.899776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.899902 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.900041 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.900170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.900296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.900425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.900550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.900687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.900815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.928601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.928782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.930487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.930751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.930861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.931240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.936929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.937204 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.937485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.938049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.938336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.938614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.944898 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.945180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.945996 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.946279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.949821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.950249 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.950692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.950946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.951223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.951485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.951590 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.951792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.952066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.952296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.952397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.952590 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.952854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.953061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.953462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.953872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.972103 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.972377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.973650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.974093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.976890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.978941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.980575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.982543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.984049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.986593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.989203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.992071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.992843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.995977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:52.996588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.996886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.997195 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.997514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.997930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:52.998349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.000633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.000935 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.001220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.001506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.001788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.002070 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.019300 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.019950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.020379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.020778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.026611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.027099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.027373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.027642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.029561 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.031411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.031860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.035023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.035437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.035893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.036316 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.036736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.044575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.046376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.046652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.049730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.050007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.050285 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.050572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.050854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.052351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.052786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.053201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.053623 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.054048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.054466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.054873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.068936 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.069218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.069500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.069791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.070069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.070349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.070622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.075087 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.078749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.082228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.083991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.085749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.086163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.086611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.093083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.094724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.096499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.096642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.099998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.100283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.100704 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.101119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.101526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.101646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.103225 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.103505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.103825 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.111846 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.113092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.113462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.113665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.114057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.120869 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.121165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.121445 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.121717 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.125436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.125887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.126307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.126723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.127141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.127567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.128039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.128465 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.128874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.129292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.129702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.130170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.130586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.130987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.131640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.131975 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.132259 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.141146 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91825) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 18:33:53.141440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.141725 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.142001 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.142271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.142559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.142832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.143108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.143379 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.143645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.143945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.144232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.144499 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.144757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91825) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 18:33:53.173921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a0d33159c0 pid: 91826 (default app) May 16 18:33:53.177574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b500b-510c-461a-8f21-3c234b9f7cbd None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:33:53.178017 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b500b-510c-461a-8f21-3c234b9f7cbd None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:33:53.178454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b500b-510c-461a-8f21-3c234b9f7cbd None None] PATH_INFO: `/v3` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:33:53.185811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a0d33159c0 pid: 91825 (default app) May 16 18:33:53.186042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 791 bytes} [Mon May 16 18:33:53 2022] GET /identity/v3/ => generated 255 bytes in 11 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:01.196978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf66217-063a-493f-b934-a4bf49847003 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:01.197612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf66217-063a-493f-b934-a4bf49847003 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:01.197612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf66217-063a-493f-b934-a4bf49847003 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:01.198801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 2/2] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:01.206716 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67841a36-351c-4bff-8861-e24d1d1cd59d None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:01.207148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67841a36-351c-4bff-8861-e24d1d1cd59d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:01.207320 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67841a36-351c-4bff-8861-e24d1d1cd59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:01.239466 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG oslo_db.sqlalchemy.engines [None req-67841a36-351c-4bff-8861-e24d1d1cd59d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:34:01.424646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG passlib.handlers.bcrypt [None req-67841a36-351c-4bff-8861-e24d1d1cd59d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91825) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 18:34:01.425062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG passlib.handlers.bcrypt [None req-67841a36-351c-4bff-8861-e24d1d1cd59d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91825) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 18:34:01.482233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-67841a36-351c-4bff-8861-e24d1d1cd59d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:01.483862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-67841a36-351c-4bff-8861-e24d1d1cd59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:01.609433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1/3] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 18:34:01.757020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf66217-063a-493f-b934-a4bf49847003 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:01.790709 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG oslo_db.sqlalchemy.engines [None req-eaf66217-063a-493f-b934-a4bf49847003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 18:34:01.918581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf66217-063a-493f-b934-a4bf49847003 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:01.923552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5cc1a-fc05-43a6-a4b6-90af647487ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:01.924249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5cc1a-fc05-43a6-a4b6-90af647487ce admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:01.924537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5cc1a-fc05-43a6-a4b6-90af647487ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:01.924819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5cc1a-fc05-43a6-a4b6-90af647487ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:01.933187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5cc1a-fc05-43a6-a4b6-90af647487ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:01.985486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1ea5cc1a-fc05-43a6-a4b6-90af647487ce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 18:34:01.985827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5cc1a-fc05-43a6-a4b6-90af647487ce admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:01.995867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 3/4] 10.222.0.72 () {58 vars in 1324 bytes} [Mon May 16 18:34:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 18:34:02.002214 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67841a36-351c-4bff-8861-e24d1d1cd59d None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:02.016519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67841a36-351c-4bff-8861-e24d1d1cd59d None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:02.020856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4982b-493b-4c35-8ddb-a3b3909166b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:02.021984 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4982b-493b-4c35-8ddb-a3b3909166b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:02.022276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4982b-493b-4c35-8ddb-a3b3909166b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:02.022556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4982b-493b-4c35-8ddb-a3b3909166b7 admin admin] PATH_INFO: `/v3/projects/44adac522ccb43149dbafba14f75fd72` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:02.024091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4982b-493b-4c35-8ddb-a3b3909166b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=44adac522ccb43149dbafba14f75fd72)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:02.074086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7fe4982b-493b-4c35-8ddb-a3b3909166b7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 18:34:02.074428 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4982b-493b-4c35-8ddb-a3b3909166b7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:02.079062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 2/5] 10.222.0.72 () {56 vars in 1207 bytes} [Mon May 16 18:34:02 2022] GET /identity/v3/projects/44adac522ccb43149dbafba14f75fd72 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:04.296351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053889c-8c2e-48c1-a36b-ef7022d7166b None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:04.296850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053889c-8c2e-48c1-a36b-ef7022d7166b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:04.296850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053889c-8c2e-48c1-a36b-ef7022d7166b None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:04.300932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 4/6] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:04.306581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51277a51-2e98-427a-a875-9feff10072bb None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:04.306973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51277a51-2e98-427a-a875-9feff10072bb None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:04.307258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51277a51-2e98-427a-a875-9feff10072bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:04.327701 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-51277a51-2e98-427a-a875-9feff10072bb None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:04.329242 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-51277a51-2e98-427a-a875-9feff10072bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:04.337066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 3/7] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 18:34:04.361545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053889c-8c2e-48c1-a36b-ef7022d7166b None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:04.373627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053889c-8c2e-48c1-a36b-ef7022d7166b None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:04.377817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09a532-ad77-4afc-aebf-02990c905c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:04.378466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09a532-ad77-4afc-aebf-02990c905c25 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:04.378747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09a532-ad77-4afc-aebf-02990c905c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:04.379020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09a532-ad77-4afc-aebf-02990c905c25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:04.386765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09a532-ad77-4afc-aebf-02990c905c25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:04.389174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09a532-ad77-4afc-aebf-02990c905c25 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:04.397840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 5/8] 10.222.0.72 () {58 vars in 1324 bytes} [Mon May 16 18:34:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:34:04.403954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51277a51-2e98-427a-a875-9feff10072bb None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:04.413218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51277a51-2e98-427a-a875-9feff10072bb None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:04.417746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f45bc-1438-464c-9f3f-ae90ec47a0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:04.418761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f45bc-1438-464c-9f3f-ae90ec47a0ca admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:04.419104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f45bc-1438-464c-9f3f-ae90ec47a0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:04.419449 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f45bc-1438-464c-9f3f-ae90ec47a0ca admin admin] PATH_INFO: `/v3/users/bf98c9865904466fa1a6dd87c28d438c` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:04.421112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f45bc-1438-464c-9f3f-ae90ec47a0ca admin admin] RBAC: Authorizing `identity:get_user(user_id=bf98c9865904466fa1a6dd87c28d438c)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:04.423068 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f45bc-1438-464c-9f3f-ae90ec47a0ca admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:04.424903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 4/9] 10.222.0.72 () {56 vars in 1198 bytes} [Mon May 16 18:34:04 2022] GET /identity/v3/users/bf98c9865904466fa1a6dd87c28d438c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:06.710860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd184572-53cc-4f7d-84b5-dbe2d0816c10 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:06.711471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd184572-53cc-4f7d-84b5-dbe2d0816c10 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:06.711471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd184572-53cc-4f7d-84b5-dbe2d0816c10 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:06.713043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 6/10] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:06.719049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00ad8-5d10-409a-b83e-b2c662e51627 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:06.719462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00ad8-5d10-409a-b83e-b2c662e51627 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:06.719614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a00ad8-5d10-409a-b83e-b2c662e51627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:06.817384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ddc8-dcb1-4c51-a038-5c4159aaa8a9 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:06.817928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ddc8-dcb1-4c51-a038-5c4159aaa8a9 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:06.818356 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685ddc8-dcb1-4c51-a038-5c4159aaa8a9 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:06.819941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 7/11] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:34:06.825825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5f857-8cf8-409b-8f86-1d8363480253 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:06.826307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5f857-8cf8-409b-8f86-1d8363480253 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:06.826724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5f857-8cf8-409b-8f86-1d8363480253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:06.845633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-c0a00ad8-5d10-409a-b83e-b2c662e51627 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:06.846833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c0a00ad8-5d10-409a-b83e-b2c662e51627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:06.867985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG passlib.handlers.bcrypt [None req-c8e5f857-8cf8-409b-8f86-1d8363480253 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91826) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 18:34:06.868645 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG passlib.handlers.bcrypt [None req-c8e5f857-8cf8-409b-8f86-1d8363480253 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91826) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 18:34:06.915191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c8e5f857-8cf8-409b-8f86-1d8363480253 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:06.917023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c8e5f857-8cf8-409b-8f86-1d8363480253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:06.926388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 5/12] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:06.950831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a00ad8-5d10-409a-b83e-b2c662e51627 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:07.018139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 8/13] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:07.043647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5f857-8cf8-409b-8f86-1d8363480253 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:07.050515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a00ad8-5d10-409a-b83e-b2c662e51627 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:07.083944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75456d96-79a7-413b-9de2-e27dd491e15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:07.084749 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75456d96-79a7-413b-9de2-e27dd491e15f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:07.085035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75456d96-79a7-413b-9de2-e27dd491e15f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:07.085314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75456d96-79a7-413b-9de2-e27dd491e15f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:07.097575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75456d96-79a7-413b-9de2-e27dd491e15f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-75456d96-79a7-413b-9de2-e27dd491e15f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:07.108938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:07.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:07.110759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 6/14] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:34:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:34:07.116290 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75456d96-79a7-413b-9de2-e27dd491e15f None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:07.145642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5f857-8cf8-409b-8f86-1d8363480253 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:07.178694 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e89a60-d6c3-48ff-8440-2a2592f8ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:07.179601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89a60-d6c3-48ff-8440-2a2592f8ade9 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:07.179918 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89a60-d6c3-48ff-8440-2a2592f8ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:07.180199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89a60-d6c3-48ff-8440-2a2592f8ade9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:07.213804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75456d96-79a7-413b-9de2-e27dd491e15f None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:07.251101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea7fdc-f095-45b8-a698-53edaf167fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:07.251808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea7fdc-f095-45b8-a698-53edaf167fa7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:07.252094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea7fdc-f095-45b8-a698-53edaf167fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:07.252371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea7fdc-f095-45b8-a698-53edaf167fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:07.252470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89a60-d6c3-48ff-8440-2a2592f8ade9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:07.253141 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea7fdc-f095-45b8-a698-53edaf167fa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:07.253450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea7fdc-f095-45b8-a698-53edaf167fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:07.253997 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89a60-d6c3-48ff-8440-2a2592f8ade9 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:07.254836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea7fdc-f095-45b8-a698-53edaf167fa7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:07.267471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 7/15] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:07.272885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea7fdc-f095-45b8-a698-53edaf167fa7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:07.351127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 9/16] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:34:07.358065 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e89a60-d6c3-48ff-8440-2a2592f8ade9 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:07.375417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea7fdc-f095-45b8-a698-53edaf167fa7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:07.412005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487e69e-a717-4dbc-90eb-e144607a4b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:07.412879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487e69e-a717-4dbc-90eb-e144607a4b42 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:07.413241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487e69e-a717-4dbc-90eb-e144607a4b42 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:07.413500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487e69e-a717-4dbc-90eb-e144607a4b42 None admin] PATH_INFO: `/v3/users/bf98c9865904466fa1a6dd87c28d438c` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:07.414620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487e69e-a717-4dbc-90eb-e144607a4b42 None admin] RBAC: Authorizing `identity:get_user(user_id=bf98c9865904466fa1a6dd87c28d438c)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:07.416098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487e69e-a717-4dbc-90eb-e144607a4b42 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:07.417765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 8/17] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:07 2022] GET /identity/v3/users/bf98c9865904466fa1a6dd87c28d438c => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:07.423885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487e69e-a717-4dbc-90eb-e144607a4b42 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:07.456609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e89a60-d6c3-48ff-8440-2a2592f8ade9 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:07.489697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca580df4-86f7-4721-8052-846b32f1c512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:07.490497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca580df4-86f7-4721-8052-846b32f1c512 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:07.490776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca580df4-86f7-4721-8052-846b32f1c512 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:07.491050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca580df4-86f7-4721-8052-846b32f1c512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:07.532075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487e69e-a717-4dbc-90eb-e144607a4b42 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:07.569480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cc632-d7cb-414a-823a-fb63002a8272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:07.570305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cc632-d7cb-414a-823a-fb63002a8272 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:07.570591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cc632-d7cb-414a-823a-fb63002a8272 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:07.570868 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cc632-d7cb-414a-823a-fb63002a8272 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:07.572156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cc632-d7cb-414a-823a-fb63002a8272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:07.573664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cc632-d7cb-414a-823a-fb63002a8272 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:07.576264 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 9/18] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:07.581910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cc632-d7cb-414a-823a-fb63002a8272 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:07.619018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca580df4-86f7-4721-8052-846b32f1c512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:07.620496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca580df4-86f7-4721-8052-846b32f1c512 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-ca580df4-86f7-4721-8052-846b32f1c512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:34:07.642538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:07.643378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:07.644226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:34:07.644226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:34:07.644226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:34:07.644226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:07.648793 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 10/19] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:07.649514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca580df4-86f7-4721-8052-846b32f1c512 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:07.681785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cc632-d7cb-414a-823a-fb63002a8272 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:07.714058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76e932-339f-49e3-b31b-39a0ff09fd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:07.714709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76e932-339f-49e3-b31b-39a0ff09fd09 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:07.715010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76e932-339f-49e3-b31b-39a0ff09fd09 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:07.715259 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76e932-339f-49e3-b31b-39a0ff09fd09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:07.716152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76e932-339f-49e3-b31b-39a0ff09fd09 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.domain.id=default, user.id=bf98c9865904466fa1a6dd87c28d438c) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:07.716631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76e932-339f-49e3-b31b-39a0ff09fd09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:07.718085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76e932-339f-49e3-b31b-39a0ff09fd09 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:07.724902 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 10/20] 10.222.0.72 () {56 vars in 1322 bytes} [Mon May 16 18:34:07 2022] GET /identity/v3/role_assignments?user.id=bf98c9865904466fa1a6dd87c28d438c&scope.domain.id=default&role.id=b104fd2e772843a0974990f965d8b589 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:07.749507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca580df4-86f7-4721-8052-846b32f1c512 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:07.786521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa20b7-ae6a-4a69-8f9a-ed21beec90fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:07.787507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa20b7-ae6a-4a69-8f9a-ed21beec90fd None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:07.788014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa20b7-ae6a-4a69-8f9a-ed21beec90fd None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:07.788517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa20b7-ae6a-4a69-8f9a-ed21beec90fd None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:07.789460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa20b7-ae6a-4a69-8f9a-ed21beec90fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:07.789960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa20b7-ae6a-4a69-8f9a-ed21beec90fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:07.791593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa20b7-ae6a-4a69-8f9a-ed21beec90fd None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:07.813161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 11/21] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:10.579032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6f207-fd52-43f2-b37c-6320cb339c0f None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:10.579555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6f207-fd52-43f2-b37c-6320cb339c0f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:10.579627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6f207-fd52-43f2-b37c-6320cb339c0f None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:10.581287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 11/22] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:10.586743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b65b-8ccc-4957-8cbb-d1f26477b9b9 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:10.587163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b65b-8ccc-4957-8cbb-d1f26477b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:10.587348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b65b-8ccc-4957-8cbb-d1f26477b9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:10.612892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-0063b65b-8ccc-4957-8cbb-d1f26477b9b9 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:10.614098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0063b65b-8ccc-4957-8cbb-d1f26477b9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:10.694087 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 12/23] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:10.697671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf88b9-ad40-4a19-bfb3-acaddf22b3ad None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:10.697959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf88b9-ad40-4a19-bfb3-acaddf22b3ad None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:10.698238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf88b9-ad40-4a19-bfb3-acaddf22b3ad None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:10.699570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 12/24] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:10.705728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134e97-1f1f-4f91-b221-ddc0b5369938 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:10.706024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134e97-1f1f-4f91-b221-ddc0b5369938 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:10.706305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134e97-1f1f-4f91-b221-ddc0b5369938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:10.728973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-4a134e97-1f1f-4f91-b221-ddc0b5369938 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:10.730224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4a134e97-1f1f-4f91-b221-ddc0b5369938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:10.772182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6343058-9769-4da7-a5c5-474114fff14a None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:10.772499 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6343058-9769-4da7-a5c5-474114fff14a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:10.772838 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6343058-9769-4da7-a5c5-474114fff14a None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:10.774247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 13/25] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:10.775062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6343058-9769-4da7-a5c5-474114fff14a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:10.826445 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 13/26] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:10.828295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528139e1-8199-435e-a8f4-7a4fc94ea031 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:10.828584 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528139e1-8199-435e-a8f4-7a4fc94ea031 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:10.832424 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528139e1-8199-435e-a8f4-7a4fc94ea031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:10.869513 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-528139e1-8199-435e-a8f4-7a4fc94ea031 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:10.870779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-528139e1-8199-435e-a8f4-7a4fc94ea031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:10.945399 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6343058-9769-4da7-a5c5-474114fff14a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:10.960487 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 14/27] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:10.969026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528139e1-8199-435e-a8f4-7a4fc94ea031 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:11.016076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38faf5-4afc-4605-98fe-1bbd6c5c50af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:11.016891 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38faf5-4afc-4605-98fe-1bbd6c5c50af None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:11.017177 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38faf5-4afc-4605-98fe-1bbd6c5c50af None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:11.017455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38faf5-4afc-4605-98fe-1bbd6c5c50af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:11.027806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38faf5-4afc-4605-98fe-1bbd6c5c50af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:11.029577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38faf5-4afc-4605-98fe-1bbd6c5c50af None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-4e38faf5-4afc-4605-98fe-1bbd6c5c50af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:34:11.048661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:11.049495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:11.050299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:34:11.050299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:34:11.050299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:34:11.050299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:11.050299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 14/28] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:11.051736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb797c-8b04-4cb0-a44d-34e934ae2c11 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:11.051736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb797c-8b04-4cb0-a44d-34e934ae2c11 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:11.051736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb797c-8b04-4cb0-a44d-34e934ae2c11 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:11.057846 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 15/29] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:11.058595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb797c-8b04-4cb0-a44d-34e934ae2c11 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:11.087526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528139e1-8199-435e-a8f4-7a4fc94ea031 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:11.122539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71797462-4867-4773-a856-01be05251320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:11.123190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71797462-4867-4773-a856-01be05251320 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:11.123469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71797462-4867-4773-a856-01be05251320 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:11.123782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71797462-4867-4773-a856-01be05251320 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:11.124538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71797462-4867-4773-a856-01be05251320 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:11.125917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71797462-4867-4773-a856-01be05251320 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:11.175081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb797c-8b04-4cb0-a44d-34e934ae2c11 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:11.211597 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3992f6-3e15-4b9f-b66b-af51558850af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:11.212427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3992f6-3e15-4b9f-b66b-af51558850af None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:11.212711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3992f6-3e15-4b9f-b66b-af51558850af None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:11.212985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3992f6-3e15-4b9f-b66b-af51558850af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:11.224135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3992f6-3e15-4b9f-b66b-af51558850af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-ce3992f6-3e15-4b9f-b66b-af51558850af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:11.232589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:11.234668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:11.236582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:11.243746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 16/30] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:34:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:11.243746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3992f6-3e15-4b9f-b66b-af51558850af None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:11.260645 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 15/31] 10.222.0.72 () {60 vars in 1131 bytes} [Mon May 16 18:34:10 2022] POST /identity/v3/roles => generated 219 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:11.265416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a88520-4f90-4fb7-80f6-f31a2e3a79e1 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:11.265799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a88520-4f90-4fb7-80f6-f31a2e3a79e1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:11.266082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a88520-4f90-4fb7-80f6-f31a2e3a79e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:11.285358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-84a88520-4f90-4fb7-80f6-f31a2e3a79e1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:11.286901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-84a88520-4f90-4fb7-80f6-f31a2e3a79e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:11.361411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 16/32] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:11.362322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a88520-4f90-4fb7-80f6-f31a2e3a79e1 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:11.416019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3992f6-3e15-4b9f-b66b-af51558850af None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:11.453550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2370463-1d06-41d0-8055-c383ef3b1cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:11.454231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370463-1d06-41d0-8055-c383ef3b1cc9 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:11.454518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370463-1d06-41d0-8055-c383ef3b1cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:11.454804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370463-1d06-41d0-8055-c383ef3b1cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:11.455547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2370463-1d06-41d0-8055-c383ef3b1cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:11.455892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2370463-1d06-41d0-8055-c383ef3b1cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:11.457300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2370463-1d06-41d0-8055-c383ef3b1cc9 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:11.470311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a88520-4f90-4fb7-80f6-f31a2e3a79e1 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:11.476835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 17/33] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:11.477685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2370463-1d06-41d0-8055-c383ef3b1cc9 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:11.508211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088bf64-234b-428f-a367-83501534c741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:11.508989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088bf64-234b-428f-a367-83501534c741 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:11.509276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088bf64-234b-428f-a367-83501534c741 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:11.509606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088bf64-234b-428f-a367-83501534c741 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:11.510380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088bf64-234b-428f-a367-83501534c741 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:11.510861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088bf64-234b-428f-a367-83501534c741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:11.513156 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088bf64-234b-428f-a367-83501534c741 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:11.527540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 17/34] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:11.529145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088bf64-234b-428f-a367-83501534c741 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:11.598818 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2370463-1d06-41d0-8055-c383ef3b1cc9 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:11.635113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61ee1-4650-4c52-bc18-78a6cff2a44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:11.635779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088bf64-234b-428f-a367-83501534c741 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:11.636269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61ee1-4650-4c52-bc18-78a6cff2a44a None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:11.636347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61ee1-4650-4c52-bc18-78a6cff2a44a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:11.636619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61ee1-4650-4c52-bc18-78a6cff2a44a None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:11.638481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61ee1-4650-4c52-bc18-78a6cff2a44a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:11.640369 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61ee1-4650-4c52-bc18-78a6cff2a44a None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:11.685554 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b2d98-ad44-41be-9a69-6ffc76058454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:11.686294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b2d98-ad44-41be-9a69-6ffc76058454 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:11.686582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b2d98-ad44-41be-9a69-6ffc76058454 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:11.686860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b2d98-ad44-41be-9a69-6ffc76058454 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:11.688684 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b2d98-ad44-41be-9a69-6ffc76058454 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:11.690370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b2d98-ad44-41be-9a69-6ffc76058454 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:11.727545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 18/35] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:34:11 2022] POST /identity/v3/projects => generated 301 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:11.728909 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b2d98-ad44-41be-9a69-6ffc76058454 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:11.824187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 18/36] 10.222.0.72 () {60 vars in 1131 bytes} [Mon May 16 18:34:11 2022] POST /identity/v3/roles => generated 225 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:11.898228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b2d98-ad44-41be-9a69-6ffc76058454 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:11.947647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7cb99-70bb-4131-af0e-19faef3df105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:11.948982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7cb99-70bb-4131-af0e-19faef3df105 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:11.949448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7cb99-70bb-4131-af0e-19faef3df105 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:11.950510 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7cb99-70bb-4131-af0e-19faef3df105 None admin] PATH_INFO: `/v3/users/bf98c9865904466fa1a6dd87c28d438c` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:11.952373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7cb99-70bb-4131-af0e-19faef3df105 None admin] RBAC: Authorizing `identity:get_user(user_id=bf98c9865904466fa1a6dd87c28d438c)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:11.954104 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7cb99-70bb-4131-af0e-19faef3df105 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:11.956128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 19/37] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:11 2022] GET /identity/v3/users/bf98c9865904466fa1a6dd87c28d438c => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:11.962167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61ee1-4650-4c52-bc18-78a6cff2a44a None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:12.011847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658404-a147-4546-84e0-5a8c488245a4 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:12.013157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658404-a147-4546-84e0-5a8c488245a4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:12.013643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658404-a147-4546-84e0-5a8c488245a4 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:12.015316 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 20/38] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:34:12.027515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e80e2-daaa-401c-a6b2-ca3d77b32f21 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:12.028779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e80e2-daaa-401c-a6b2-ca3d77b32f21 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:12.029286 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e80e2-daaa-401c-a6b2-ca3d77b32f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:12.055114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-501e80e2-daaa-401c-a6b2-ca3d77b32f21 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:12.059510 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-501e80e2-daaa-401c-a6b2-ca3d77b32f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:12.130841 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61ee1-4650-4c52-bc18-78a6cff2a44a None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:12.169758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 21/39] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:12.181900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c81ff-11ec-4113-86e2-bdb5d98e1b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:12.182697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c81ff-11ec-4113-86e2-bdb5d98e1b64 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:12.183046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c81ff-11ec-4113-86e2-bdb5d98e1b64 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:12.183272 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c81ff-11ec-4113-86e2-bdb5d98e1b64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:12.185155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c81ff-11ec-4113-86e2-bdb5d98e1b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:12.186748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c81ff-11ec-4113-86e2-bdb5d98e1b64 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:12.188643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 19/40] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:12.194330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e80e2-daaa-401c-a6b2-ca3d77b32f21 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:12.196108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c81ff-11ec-4113-86e2-bdb5d98e1b64 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:12.302004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e80e2-daaa-401c-a6b2-ca3d77b32f21 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:12.305957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c81ff-11ec-4113-86e2-bdb5d98e1b64 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:12.334657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ad836-2e2b-4e50-8705-f9a36f04657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:12.335537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ad836-2e2b-4e50-8705-f9a36f04657f None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:12.335861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ad836-2e2b-4e50-8705-f9a36f04657f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:12.336159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ad836-2e2b-4e50-8705-f9a36f04657f None admin] PATH_INFO: `/v3/domains/default/users/bf98c9865904466fa1a6dd87c28d438c/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:12.337883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06357547-31d8-464f-9b4b-6ab7bc0723c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:12.338150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ad836-2e2b-4e50-8705-f9a36f04657f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bf98c9865904466fa1a6dd87c28d438c, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:12.338680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06357547-31d8-464f-9b4b-6ab7bc0723c8 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:12.338973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06357547-31d8-464f-9b4b-6ab7bc0723c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:12.339250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06357547-31d8-464f-9b4b-6ab7bc0723c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:12.339611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ad836-2e2b-4e50-8705-f9a36f04657f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:12.340525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06357547-31d8-464f-9b4b-6ab7bc0723c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:12.342039 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06357547-31d8-464f-9b4b-6ab7bc0723c8 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:12.343939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 20/41] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:12.345206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8b32-59c7-441f-96c3-f12370d50836 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:12.345497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8b32-59c7-441f-96c3-f12370d50836 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:12.345776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8b32-59c7-441f-96c3-f12370d50836 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:12.346997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 21/42] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:12.349957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8b32-59c7-441f-96c3-f12370d50836 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:12.359780 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 22/43] 10.222.0.72 () {58 vars in 1361 bytes} [Mon May 16 18:34:12 2022] PUT /identity/v3/domains/default/users/bf98c9865904466fa1a6dd87c28d438c/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:34:12.361063 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79d41-3ad8-4750-befa-049ae36fec33 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:12.361362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79d41-3ad8-4750-befa-049ae36fec33 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:12.361636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79d41-3ad8-4750-befa-049ae36fec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:12.378393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-acb79d41-3ad8-4750-befa-049ae36fec33 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:12.379624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-acb79d41-3ad8-4750-befa-049ae36fec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:12.457287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 23/44] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:12.476498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8b32-59c7-441f-96c3-f12370d50836 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:12.481798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb79d41-3ad8-4750-befa-049ae36fec33 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:12.514450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef32c9-5d92-4ba0-90a6-3e1fbe7bb30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:12.515658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef32c9-5d92-4ba0-90a6-3e1fbe7bb30b None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:12.515986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef32c9-5d92-4ba0-90a6-3e1fbe7bb30b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:12.516277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef32c9-5d92-4ba0-90a6-3e1fbe7bb30b None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:12.517020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef32c9-5d92-4ba0-90a6-3e1fbe7bb30b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:12.518506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef32c9-5d92-4ba0-90a6-3e1fbe7bb30b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:12.547375 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 22/45] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:34:12 2022] POST /identity/v3/projects => generated 312 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:34:12.590000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb79d41-3ad8-4750-befa-049ae36fec33 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:12.626141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654da388-1b0b-4efb-acb3-0c8ca3c682a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:12.626837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654da388-1b0b-4efb-acb3-0c8ca3c682a8 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:12.627114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654da388-1b0b-4efb-acb3-0c8ca3c682a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:12.627387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654da388-1b0b-4efb-acb3-0c8ca3c682a8 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:12.628188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654da388-1b0b-4efb-acb3-0c8ca3c682a8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:12.629592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654da388-1b0b-4efb-acb3-0c8ca3c682a8 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:12.644453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1131 bytes} [Mon May 16 18:34:12 2022] POST /identity/v3/roles => generated 223 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:34:14.639119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bac93-e080-4d33-949e-8703aadca293 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:14.639703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bac93-e080-4d33-949e-8703aadca293 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:14.639703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bac93-e080-4d33-949e-8703aadca293 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:14.641433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 23/47] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:14.647491 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ec75-b669-4204-be81-ebbf9369817a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:14.648058 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ec75-b669-4204-be81-ebbf9369817a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:14.648058 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ec75-b669-4204-be81-ebbf9369817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:14.666068 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-3ce4ec75-b669-4204-be81-ebbf9369817a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:14.667308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3ce4ec75-b669-4204-be81-ebbf9369817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:14.732041 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 25/48] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:14.754955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bac93-e080-4d33-949e-8703aadca293 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:14.834087 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7032a-6209-4326-ae76-52fe0a239af1 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:14.834380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7032a-6209-4326-ae76-52fe0a239af1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:14.834673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7032a-6209-4326-ae76-52fe0a239af1 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:14.836105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 26/49] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:14.841692 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee5e68-8ae8-47fa-9841-6f712a5af1c5 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:14.841986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee5e68-8ae8-47fa-9841-6f712a5af1c5 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:14.842272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee5e68-8ae8-47fa-9841-6f712a5af1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:14.853672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bac93-e080-4d33-949e-8703aadca293 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:14.858463 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-44ee5e68-8ae8-47fa-9841-6f712a5af1c5 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:14.859646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-44ee5e68-8ae8-47fa-9841-6f712a5af1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:14.885771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09f4a-1177-48d5-b8fb-d13fecfebf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:14.886564 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09f4a-1177-48d5-b8fb-d13fecfebf79 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:14.886856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09f4a-1177-48d5-b8fb-d13fecfebf79 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:14.887137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09f4a-1177-48d5-b8fb-d13fecfebf79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:14.898063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e09f4a-1177-48d5-b8fb-d13fecfebf79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-12e09f4a-1177-48d5-b8fb-d13fecfebf79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:14.907007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:14.907980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:14.908761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 24/50] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:34:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:14.913946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09f4a-1177-48d5-b8fb-d13fecfebf79 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:14.927768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 27/51] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:14.952192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee5e68-8ae8-47fa-9841-6f712a5af1c5 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:15.010082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09f4a-1177-48d5-b8fb-d13fecfebf79 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:15.041991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9eed6-dbe4-4218-ba9d-3edf093260dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:15.042649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9eed6-dbe4-4218-ba9d-3edf093260dc None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:15.042935 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9eed6-dbe4-4218-ba9d-3edf093260dc None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:15.043215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9eed6-dbe4-4218-ba9d-3edf093260dc None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:15.043642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee5e68-8ae8-47fa-9841-6f712a5af1c5 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:15.044190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9eed6-dbe4-4218-ba9d-3edf093260dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:15.044501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9eed6-dbe4-4218-ba9d-3edf093260dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:15.045942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9eed6-dbe4-4218-ba9d-3edf093260dc None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:15.053661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 25/52] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:15.059565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9eed6-dbe4-4218-ba9d-3edf093260dc None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:15.077703 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e3e8d-c9d4-42bb-a2e2-86e8bfc2adaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:15.078503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e3e8d-c9d4-42bb-a2e2-86e8bfc2adaf None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:15.078787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e3e8d-c9d4-42bb-a2e2-86e8bfc2adaf None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:15.079063 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e3e8d-c9d4-42bb-a2e2-86e8bfc2adaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:15.080266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e3e8d-c9d4-42bb-a2e2-86e8bfc2adaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:15.081701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e3e8d-c9d4-42bb-a2e2-86e8bfc2adaf None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:15.083326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 28/53] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:15.088876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e3e8d-c9d4-42bb-a2e2-86e8bfc2adaf None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:15.156002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9eed6-dbe4-4218-ba9d-3edf093260dc None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:15.183816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e3e8d-c9d4-42bb-a2e2-86e8bfc2adaf None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:15.187682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d2444-b905-4a45-b07b-761772d0f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:15.188592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2444-b905-4a45-b07b-761772d0f2c5 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:15.188879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2444-b905-4a45-b07b-761772d0f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:15.189161 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2444-b905-4a45-b07b-761772d0f2c5 None admin] PATH_INFO: `/v3/users/bf98c9865904466fa1a6dd87c28d438c` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:15.190520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d2444-b905-4a45-b07b-761772d0f2c5 None admin] RBAC: Authorizing `identity:get_user(user_id=bf98c9865904466fa1a6dd87c28d438c)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:15.192007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d2444-b905-4a45-b07b-761772d0f2c5 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:15.193648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 26/54] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:15 2022] GET /identity/v3/users/bf98c9865904466fa1a6dd87c28d438c => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:15.199095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d2444-b905-4a45-b07b-761772d0f2c5 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:15.217304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06600ccd-3ccb-4626-b40c-3b63a09b331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:15.217977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600ccd-3ccb-4626-b40c-3b63a09b331e None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:15.218519 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600ccd-3ccb-4626-b40c-3b63a09b331e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:15.218795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06600ccd-3ccb-4626-b40c-3b63a09b331e None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:15.219574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06600ccd-3ccb-4626-b40c-3b63a09b331e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:15.221039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06600ccd-3ccb-4626-b40c-3b63a09b331e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:15.247790 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 29/55] 10.222.0.72 () {60 vars in 1140 bytes} [Mon May 16 18:34:15 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:34:15.303325 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d2444-b905-4a45-b07b-761772d0f2c5 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:15.338202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddbc31-090e-4388-8188-83a9a4850d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:15.339010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddbc31-090e-4388-8188-83a9a4850d49 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:15.339298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddbc31-090e-4388-8188-83a9a4850d49 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:15.339581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddbc31-090e-4388-8188-83a9a4850d49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:15.341666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddbc31-090e-4388-8188-83a9a4850d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:15.343149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddbc31-090e-4388-8188-83a9a4850d49 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:15.345129 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 27/56] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:15.351199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06600ccd-3ccb-4626-b40c-3b63a09b331e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:15.451512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06600ccd-3ccb-4626-b40c-3b63a09b331e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:15.484828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e7441-e17e-4820-bbf8-79156a17f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:15.485496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e7441-e17e-4820-bbf8-79156a17f525 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:15.485783 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e7441-e17e-4820-bbf8-79156a17f525 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:15.486061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e7441-e17e-4820-bbf8-79156a17f525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:15.486913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e7441-e17e-4820-bbf8-79156a17f525 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.domain.id=default, user.id=bf98c9865904466fa1a6dd87c28d438c) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:15.487224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e7441-e17e-4820-bbf8-79156a17f525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:15.488718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e7441-e17e-4820-bbf8-79156a17f525 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:15.496646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 30/57] 10.222.0.72 () {56 vars in 1322 bytes} [Mon May 16 18:34:15 2022] GET /identity/v3/role_assignments?user.id=bf98c9865904466fa1a6dd87c28d438c&scope.domain.id=default&role.id=b104fd2e772843a0974990f965d8b589 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:17.523415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5c079-7c6e-4140-a247-e570d517b8f9 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:17.523976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5c079-7c6e-4140-a247-e570d517b8f9 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:17.524088 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5c079-7c6e-4140-a247-e570d517b8f9 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:17.525386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 28/58] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:17.531211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007b2c5-adf1-46f8-89e5-f7f11045cd92 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:17.531627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007b2c5-adf1-46f8-89e5-f7f11045cd92 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:17.531825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007b2c5-adf1-46f8-89e5-f7f11045cd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:17.549319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d007b2c5-adf1-46f8-89e5-f7f11045cd92 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:17.550500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d007b2c5-adf1-46f8-89e5-f7f11045cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:17.613198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 31/59] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:17.638322 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5c079-7c6e-4140-a247-e570d517b8f9 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:17.734721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5c079-7c6e-4140-a247-e570d517b8f9 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:17.766326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e56fb3-df4f-44fe-aea7-5947b497c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:17.767113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56fb3-df4f-44fe-aea7-5947b497c384 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:17.767397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56fb3-df4f-44fe-aea7-5947b497c384 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:17.767675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56fb3-df4f-44fe-aea7-5947b497c384 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:17.768863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e56fb3-df4f-44fe-aea7-5947b497c384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:17.770304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e56fb3-df4f-44fe-aea7-5947b497c384 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:17.771928 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 29/60] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:17.777348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007b2c5-adf1-46f8-89e5-f7f11045cd92 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:17.870561 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007b2c5-adf1-46f8-89e5-f7f11045cd92 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:17.902183 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ae019-84d8-4f7d-8e5c-c7afdfd177af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:17.902931 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ae019-84d8-4f7d-8e5c-c7afdfd177af None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:17.903425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ae019-84d8-4f7d-8e5c-c7afdfd177af None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:17.903741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ae019-84d8-4f7d-8e5c-c7afdfd177af None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:17.904476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ae019-84d8-4f7d-8e5c-c7afdfd177af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:17.905912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ae019-84d8-4f7d-8e5c-c7afdfd177af None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:17.930237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 32/61] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:34:17 2022] POST /identity/v3/users => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:21.260016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea77be-8871-402d-82c2-f096dcb49a51 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:21.261058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea77be-8871-402d-82c2-f096dcb49a51 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:21.261551 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea77be-8871-402d-82c2-f096dcb49a51 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:21.263229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 30/62] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:21.268227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7592-347e-4f8b-b26e-a395c3400fd3 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:21.268690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410aa2a-f943-4d68-8fde-8da489591e6b None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:21.268957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410aa2a-f943-4d68-8fde-8da489591e6b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:21.270007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410aa2a-f943-4d68-8fde-8da489591e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:21.270464 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7592-347e-4f8b-b26e-a395c3400fd3 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:21.271777 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7592-347e-4f8b-b26e-a395c3400fd3 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:21.273400 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 33/63] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:21.279753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49fe5-807f-4c70-99cd-d57d82954049 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:21.280313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49fe5-807f-4c70-99cd-d57d82954049 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:21.280801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e49fe5-807f-4c70-99cd-d57d82954049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:21.301835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4410aa2a-f943-4d68-8fde-8da489591e6b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:21.303371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4410aa2a-f943-4d68-8fde-8da489591e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:21.312126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-72e49fe5-807f-4c70-99cd-d57d82954049 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:21.313312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-72e49fe5-807f-4c70-99cd-d57d82954049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:21.428494 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 34/64] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:21.449134 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 31/65] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:21.453711 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e49fe5-807f-4c70-99cd-d57d82954049 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:21.481597 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410aa2a-f943-4d68-8fde-8da489591e6b None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:21.557290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e49fe5-807f-4c70-99cd-d57d82954049 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:21.597310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669b5d7-4560-42cd-9a50-39ff6bea09c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:21.598126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669b5d7-4560-42cd-9a50-39ff6bea09c6 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:21.598414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669b5d7-4560-42cd-9a50-39ff6bea09c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:21.598695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669b5d7-4560-42cd-9a50-39ff6bea09c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:21.616578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669b5d7-4560-42cd-9a50-39ff6bea09c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-f669b5d7-4560-42cd-9a50-39ff6bea09c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:21.625855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:21.626721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:21.627564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 35/66] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:34:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:21.632982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cedb90-b267-42bd-89b1-c64503e353fe None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:21.633276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cedb90-b267-42bd-89b1-c64503e353fe None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:21.633559 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cedb90-b267-42bd-89b1-c64503e353fe None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:21.634892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 36/67] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:21.635602 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cedb90-b267-42bd-89b1-c64503e353fe None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:21.662459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410aa2a-f943-4d68-8fde-8da489591e6b None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:21.701054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727cb5-ed69-46ed-ab9f-ad889036d1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:21.702163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727cb5-ed69-46ed-ab9f-ad889036d1ea None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:21.702664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727cb5-ed69-46ed-ab9f-ad889036d1ea None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:21.703122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727cb5-ed69-46ed-ab9f-ad889036d1ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:21.713844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9727cb5-ed69-46ed-ab9f-ad889036d1ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-b9727cb5-ed69-46ed-ab9f-ad889036d1ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:21.723861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:21.724732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:21.725489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:21.727988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 32/68] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:34:21.729390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f2c4b-b93b-445c-8108-c2a19236ff30 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:21.729856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f2c4b-b93b-445c-8108-c2a19236ff30 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:21.730312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f2c4b-b93b-445c-8108-c2a19236ff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:21.747943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-7d4f2c4b-b93b-445c-8108-c2a19236ff30 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:21.749420 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7d4f2c4b-b93b-445c-8108-c2a19236ff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:21.765351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cedb90-b267-42bd-89b1-c64503e353fe None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:21.820445 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83986ab9-5494-41cf-96a4-d221cbf964de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:21.821468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986ab9-5494-41cf-96a4-d221cbf964de None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:21.821767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986ab9-5494-41cf-96a4-d221cbf964de None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:21.822243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986ab9-5494-41cf-96a4-d221cbf964de None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:21.823464 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83986ab9-5494-41cf-96a4-d221cbf964de None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:21.823951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83986ab9-5494-41cf-96a4-d221cbf964de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:21.826907 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83986ab9-5494-41cf-96a4-d221cbf964de None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:21.830290 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 33/69] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:21.831211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f2c4b-b93b-445c-8108-c2a19236ff30 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:21.837671 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 37/70] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:21.843053 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83986ab9-5494-41cf-96a4-d221cbf964de None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:21.949090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f2c4b-b93b-445c-8108-c2a19236ff30 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:21.972553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83986ab9-5494-41cf-96a4-d221cbf964de None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:21.984664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a99f78-46bb-4108-a36d-469ba98ee9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:21.985342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a99f78-46bb-4108-a36d-469ba98ee9dd None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:21.985639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a99f78-46bb-4108-a36d-469ba98ee9dd None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:21.985922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a99f78-46bb-4108-a36d-469ba98ee9dd None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:21.986743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a99f78-46bb-4108-a36d-469ba98ee9dd None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:21.986990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a99f78-46bb-4108-a36d-469ba98ee9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:21.988435 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a99f78-46bb-4108-a36d-469ba98ee9dd None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:22.001303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 34/71] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:22.001303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a99f78-46bb-4108-a36d-469ba98ee9dd None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:22.014067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f29178-f997-4c9e-9a0f-081ae37da0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:22.014959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f29178-f997-4c9e-9a0f-081ae37da0fc None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.015246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f29178-f997-4c9e-9a0f-081ae37da0fc None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.015524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f29178-f997-4c9e-9a0f-081ae37da0fc None admin] PATH_INFO: `/v3/users/bf98c9865904466fa1a6dd87c28d438c` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.016793 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f29178-f997-4c9e-9a0f-081ae37da0fc None admin] RBAC: Authorizing `identity:get_user(user_id=bf98c9865904466fa1a6dd87c28d438c)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:22.018258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f29178-f997-4c9e-9a0f-081ae37da0fc None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:22.020080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 38/72] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:21 2022] GET /identity/v3/users/bf98c9865904466fa1a6dd87c28d438c => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:22.025425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b8015-f5b2-44cc-a78e-558dab7d958f None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.025715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b8015-f5b2-44cc-a78e-558dab7d958f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.025997 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b8015-f5b2-44cc-a78e-558dab7d958f None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.027276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 39/73] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:22.028746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b8015-f5b2-44cc-a78e-558dab7d958f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:22.100874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a99f78-46bb-4108-a36d-469ba98ee9dd None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:22.127423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b8015-f5b2-44cc-a78e-558dab7d958f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:22.133329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080074f-b39c-46c8-873f-d8fa2c952ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:22.134148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080074f-b39c-46c8-873f-d8fa2c952ca1 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.134440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080074f-b39c-46c8-873f-d8fa2c952ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.134724 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080074f-b39c-46c8-873f-d8fa2c952ca1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.145422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080074f-b39c-46c8-873f-d8fa2c952ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-5080074f-b39c-46c8-873f-d8fa2c952ca1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:22.154610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:22.155553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:22.156341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 35/74] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:34:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:22.156955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080074f-b39c-46c8-873f-d8fa2c952ca1 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:22.164734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bd9f8-b9b6-4f31-bd80-4af77fcfcb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:22.165622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bd9f8-b9b6-4f31-bd80-4af77fcfcb57 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.165912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bd9f8-b9b6-4f31-bd80-4af77fcfcb57 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.166191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bd9f8-b9b6-4f31-bd80-4af77fcfcb57 None admin] PATH_INFO: `/v3/users/9736248d560340dba1575baeea8ca3ec` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.180896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bd9f8-b9b6-4f31-bd80-4af77fcfcb57 None admin] RBAC: Authorizing `identity:get_user(user_id=9736248d560340dba1575baeea8ca3ec)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:22.182348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bd9f8-b9b6-4f31-bd80-4af77fcfcb57 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:22.184163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 40/75] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:22 2022] GET /identity/v3/users/9736248d560340dba1575baeea8ca3ec => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:22.185471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d357-53c8-4f1a-b22e-41e6b70f1063 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.185763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d357-53c8-4f1a-b22e-41e6b70f1063 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.186047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d357-53c8-4f1a-b22e-41e6b70f1063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.201999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-ded5d357-53c8-4f1a-b22e-41e6b70f1063 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:22.203211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ded5d357-53c8-4f1a-b22e-41e6b70f1063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:22.253206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080074f-b39c-46c8-873f-d8fa2c952ca1 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:22.269194 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 41/76] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:22.270499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ab8fc-b2b4-4b6f-8663-e659b4931dbf None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.270800 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ab8fc-b2b4-4b6f-8663-e659b4931dbf None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.271090 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ab8fc-b2b4-4b6f-8663-e659b4931dbf None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.272560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 42/77] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:22.277309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ab8fc-b2b4-4b6f-8663-e659b4931dbf None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:22.285537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefef1f-5125-4272-913a-f9aaa64f99fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:22.286200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefef1f-5125-4272-913a-f9aaa64f99fa None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.286490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefef1f-5125-4272-913a-f9aaa64f99fa None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.286772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefef1f-5125-4272-913a-f9aaa64f99fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.351861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefef1f-5125-4272-913a-f9aaa64f99fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:22.353265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefef1f-5125-4272-913a-f9aaa64f99fa None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:22.378004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ab8fc-b2b4-4b6f-8663-e659b4931dbf None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:22.411640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a69f5-c600-449e-905e-d7d882d8e797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:22.412342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a69f5-c600-449e-905e-d7d882d8e797 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.412628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a69f5-c600-449e-905e-d7d882d8e797 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.412916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a69f5-c600-449e-905e-d7d882d8e797 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.413675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a69f5-c600-449e-905e-d7d882d8e797 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:22.413986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a69f5-c600-449e-905e-d7d882d8e797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:22.415373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a69f5-c600-449e-905e-d7d882d8e797 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:22.423481 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 43/78] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:34:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:22.424303 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a69f5-c600-449e-905e-d7d882d8e797 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:22.445525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 36/79] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:22.446796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711287b1-d184-4bf4-afb6-8a64bc7db488 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.447086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711287b1-d184-4bf4-afb6-8a64bc7db488 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.447365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711287b1-d184-4bf4-afb6-8a64bc7db488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.464056 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-711287b1-d184-4bf4-afb6-8a64bc7db488 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:22.465278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-711287b1-d184-4bf4-afb6-8a64bc7db488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:22.519816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a69f5-c600-449e-905e-d7d882d8e797 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:22.528326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 37/80] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:22.529154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711287b1-d184-4bf4-afb6-8a64bc7db488 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:22.564570 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e5ed3-9adb-4119-b7f1-05e7aab0e1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:22.565222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e5ed3-9adb-4119-b7f1-05e7aab0e1cf None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.565502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e5ed3-9adb-4119-b7f1-05e7aab0e1cf None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.565775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e5ed3-9adb-4119-b7f1-05e7aab0e1cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.620920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711287b1-d184-4bf4-afb6-8a64bc7db488 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:22.628835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e5ed3-9adb-4119-b7f1-05e7aab0e1cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:22.630290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e5ed3-9adb-4119-b7f1-05e7aab0e1cf None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:22.653317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e50df-6e93-4625-8f90-9f009299f3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:22.654115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e50df-6e93-4625-8f90-9f009299f3c5 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.654406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e50df-6e93-4625-8f90-9f009299f3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.654686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e50df-6e93-4625-8f90-9f009299f3c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.664311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e50df-6e93-4625-8f90-9f009299f3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-116e50df-6e93-4625-8f90-9f009299f3c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:22.672096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:22.672959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 38/81] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:22.678605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e50df-6e93-4625-8f90-9f009299f3c5 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:22.725120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 44/82] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:22.725958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e5ed3-9adb-4119-b7f1-05e7aab0e1cf None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:22.770271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e50df-6e93-4625-8f90-9f009299f3c5 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:22.802096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84708ae-d761-45d0-b205-0736170e9554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:22.802967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84708ae-d761-45d0-b205-0736170e9554 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.803258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84708ae-d761-45d0-b205-0736170e9554 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.803540 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84708ae-d761-45d0-b205-0736170e9554 None admin] PATH_INFO: `/v3/users/9736248d560340dba1575baeea8ca3ec` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.804780 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84708ae-d761-45d0-b205-0736170e9554 None admin] RBAC: Authorizing `identity:get_user(user_id=9736248d560340dba1575baeea8ca3ec)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:22.806239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84708ae-d761-45d0-b205-0736170e9554 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:22.807881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 39/83] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:22 2022] GET /identity/v3/users/9736248d560340dba1575baeea8ca3ec => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:22.808641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84708ae-d761-45d0-b205-0736170e9554 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:22.817839 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e5ed3-9adb-4119-b7f1-05e7aab0e1cf None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:22.850349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c25e70-61ab-42b5-81f8-0682c3d9ddf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:22.851202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c25e70-61ab-42b5-81f8-0682c3d9ddf6 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.851479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c25e70-61ab-42b5-81f8-0682c3d9ddf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.851774 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c25e70-61ab-42b5-81f8-0682c3d9ddf6 None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.852953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c25e70-61ab-42b5-81f8-0682c3d9ddf6 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:22.854391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c25e70-61ab-42b5-81f8-0682c3d9ddf6 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:22.856320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 45/84] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:22 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:22.861239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c25e70-61ab-42b5-81f8-0682c3d9ddf6 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:22.907185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84708ae-d761-45d0-b205-0736170e9554 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:22.938811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f7ca-089f-4ce1-ad18-c2d6277abb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:22.939601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f7ca-089f-4ce1-ad18-c2d6277abb12 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.939912 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f7ca-089f-4ce1-ad18-c2d6277abb12 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.940189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f7ca-089f-4ce1-ad18-c2d6277abb12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.941361 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575f7ca-089f-4ce1-ad18-c2d6277abb12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:22.942808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575f7ca-089f-4ce1-ad18-c2d6277abb12 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:22.944444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 40/85] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:22.945199 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f7ca-089f-4ce1-ad18-c2d6277abb12 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:22.954222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c25e70-61ab-42b5-81f8-0682c3d9ddf6 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:22.986888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3bb10-4394-42cd-879d-e1fb8b1c6873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:22.987557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3bb10-4394-42cd-879d-e1fb8b1c6873 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:22.987874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3bb10-4394-42cd-879d-e1fb8b1c6873 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:22.988149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3bb10-4394-42cd-879d-e1fb8b1c6873 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:22.988896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3bb10-4394-42cd-879d-e1fb8b1c6873 None admin] RBAC: Adding query filter params (name=member) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:22.989199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3bb10-4394-42cd-879d-e1fb8b1c6873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:22.990567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3bb10-4394-42cd-879d-e1fb8b1c6873 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:22.998455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 46/86] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:22.999241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3bb10-4394-42cd-879d-e1fb8b1c6873 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:23.047773 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f7ca-089f-4ce1-ad18-c2d6277abb12 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:23.079465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e97096-f85a-4f1e-a23a-ff34f691e9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:23.080352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e97096-f85a-4f1e-a23a-ff34f691e9cd None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:23.080639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e97096-f85a-4f1e-a23a-ff34f691e9cd None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:23.080917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e97096-f85a-4f1e-a23a-ff34f691e9cd None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:23.082102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e97096-f85a-4f1e-a23a-ff34f691e9cd None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:23.083557 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e97096-f85a-4f1e-a23a-ff34f691e9cd None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:23.085288 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 41/87] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:22 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:23.086044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e97096-f85a-4f1e-a23a-ff34f691e9cd None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:23.092726 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3bb10-4394-42cd-879d-e1fb8b1c6873 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:23.124534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5ad61-b7a5-4df9-8e5d-ece05756da6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:23.125183 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5ad61-b7a5-4df9-8e5d-ece05756da6a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:23.125470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5ad61-b7a5-4df9-8e5d-ece05756da6a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:23.125747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5ad61-b7a5-4df9-8e5d-ece05756da6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:23.180424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e97096-f85a-4f1e-a23a-ff34f691e9cd None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:23.190900 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5ad61-b7a5-4df9-8e5d-ece05756da6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:23.192392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5ad61-b7a5-4df9-8e5d-ece05756da6a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:23.213950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e142f-d9c6-46d6-83b7-ae4d2a54ddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:23.214612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e142f-d9c6-46d6-83b7-ae4d2a54ddc9 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:23.214908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e142f-d9c6-46d6-83b7-ae4d2a54ddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:23.215734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e142f-d9c6-46d6-83b7-ae4d2a54ddc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:23.216779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e142f-d9c6-46d6-83b7-ae4d2a54ddc9 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=3c0793f1f4e4422f921a1d20504a3726, user.id=bf98c9865904466fa1a6dd87c28d438c) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:23.217097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e142f-d9c6-46d6-83b7-ae4d2a54ddc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:23.218796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e142f-d9c6-46d6-83b7-ae4d2a54ddc9 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:23.224082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 42/88] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:23 2022] GET /identity/v3/role_assignments?user.id=bf98c9865904466fa1a6dd87c28d438c&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=b104fd2e772843a0974990f965d8b589 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:23.224847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e142f-d9c6-46d6-83b7-ae4d2a54ddc9 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:23.305959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 47/89] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:23.305959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5ad61-b7a5-4df9-8e5d-ece05756da6a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:23.346477 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e142f-d9c6-46d6-83b7-ae4d2a54ddc9 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:23.383842 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbd99-2994-47bd-993f-81b019502e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:23.384545 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbd99-2994-47bd-993f-81b019502e12 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:23.384836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbd99-2994-47bd-993f-81b019502e12 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:23.385495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfbd99-2994-47bd-993f-81b019502e12 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:23.385923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfbd99-2994-47bd-993f-81b019502e12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:23.387546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfbd99-2994-47bd-993f-81b019502e12 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:23.414662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5ad61-b7a5-4df9-8e5d-ece05756da6a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:23.416111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 43/90] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:34:23 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:23.416957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbd99-2994-47bd-993f-81b019502e12 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:23.455230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289063f1-c5a0-44a3-9bdb-106e1a312a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:23.456529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289063f1-c5a0-44a3-9bdb-106e1a312a40 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:23.456529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289063f1-c5a0-44a3-9bdb-106e1a312a40 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:23.456716 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289063f1-c5a0-44a3-9bdb-106e1a312a40 None admin] PATH_INFO: `/v3/users/9736248d560340dba1575baeea8ca3ec` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:23.458028 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289063f1-c5a0-44a3-9bdb-106e1a312a40 None admin] RBAC: Authorizing `identity:get_user(user_id=9736248d560340dba1575baeea8ca3ec)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:23.459543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289063f1-c5a0-44a3-9bdb-106e1a312a40 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:23.461510 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 48/91] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:23 2022] GET /identity/v3/users/9736248d560340dba1575baeea8ca3ec => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:23.462084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289063f1-c5a0-44a3-9bdb-106e1a312a40 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:23.536206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfbd99-2994-47bd-993f-81b019502e12 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:23.573867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9f63d-c821-40fb-a109-83d7e155a750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:23.575354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9f63d-c821-40fb-a109-83d7e155a750 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:23.575819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9f63d-c821-40fb-a109-83d7e155a750 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:23.576244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9f63d-c821-40fb-a109-83d7e155a750 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:23.576676 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289063f1-c5a0-44a3-9bdb-106e1a312a40 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:23.577457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9f63d-c821-40fb-a109-83d7e155a750 None admin] RBAC: Adding query filter params (role.id=627af591fe55445c83abe50f753404c9, scope.project.id=3c0793f1f4e4422f921a1d20504a3726, user.id=9736248d560340dba1575baeea8ca3ec) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:23.577924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9f63d-c821-40fb-a109-83d7e155a750 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:23.579566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9f63d-c821-40fb-a109-83d7e155a750 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:23.586392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 44/92] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:23 2022] GET /identity/v3/role_assignments?user.id=9736248d560340dba1575baeea8ca3ec&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=627af591fe55445c83abe50f753404c9 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:23.587632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9f63d-c821-40fb-a109-83d7e155a750 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:23.630887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe717f-1119-4ed3-8d51-2716bab8cbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:23.632005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe717f-1119-4ed3-8d51-2716bab8cbce None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:23.632291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe717f-1119-4ed3-8d51-2716bab8cbce None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:23.632568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe717f-1119-4ed3-8d51-2716bab8cbce None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:23.633966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe717f-1119-4ed3-8d51-2716bab8cbce None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:23.636213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe717f-1119-4ed3-8d51-2716bab8cbce None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:23.640065 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 49/93] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:23 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:23.646449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe717f-1119-4ed3-8d51-2716bab8cbce None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:23.712098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9f63d-c821-40fb-a109-83d7e155a750 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:23.749553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac515b4b-22f2-4b8d-b634-e9f145c1ec4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:23.750603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac515b4b-22f2-4b8d-b634-e9f145c1ec4b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:23.751087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac515b4b-22f2-4b8d-b634-e9f145c1ec4b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:23.751563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac515b4b-22f2-4b8d-b634-e9f145c1ec4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:23.756786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe717f-1119-4ed3-8d51-2716bab8cbce None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:23.794256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aabb02-355a-4605-9745-d3ba7763500f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:23.794958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aabb02-355a-4605-9745-d3ba7763500f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:23.795240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aabb02-355a-4605-9745-d3ba7763500f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:23.795523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aabb02-355a-4605-9745-d3ba7763500f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:23.796420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aabb02-355a-4605-9745-d3ba7763500f None admin] RBAC: Adding query filter params (role.id=004dfaca095a4141ae157de95aa6390a, scope.project.id=3c0793f1f4e4422f921a1d20504a3726, user.id=9736248d560340dba1575baeea8ca3ec) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:23.796738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aabb02-355a-4605-9745-d3ba7763500f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:23.798207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aabb02-355a-4605-9745-d3ba7763500f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:23.808578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 50/94] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:23 2022] GET /identity/v3/role_assignments?user.id=9736248d560340dba1575baeea8ca3ec&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=004dfaca095a4141ae157de95aa6390a => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:23.848852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac515b4b-22f2-4b8d-b634-e9f145c1ec4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:23.851285 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac515b4b-22f2-4b8d-b634-e9f145c1ec4b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:23.973655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 45/95] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:23.979454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aabb02-355a-4605-9745-d3ba7763500f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:24.100646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aabb02-355a-4605-9745-d3ba7763500f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:24.138618 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68688e-164d-4e45-858b-a094168ea1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:24.139496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68688e-164d-4e45-858b-a094168ea1cd None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:24.139823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68688e-164d-4e45-858b-a094168ea1cd None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:24.140106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68688e-164d-4e45-858b-a094168ea1cd None admin] PATH_INFO: `/v3/projects/91199bf0cd184c0eb867f99d5018bb1d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:24.141629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68688e-164d-4e45-858b-a094168ea1cd None admin] RBAC: Authorizing `identity:get_project(project_id=91199bf0cd184c0eb867f99d5018bb1d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:24.143138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68688e-164d-4e45-858b-a094168ea1cd None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:24.144897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 51/96] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:23 2022] GET /identity/v3/projects/91199bf0cd184c0eb867f99d5018bb1d => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:24.150821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac515b4b-22f2-4b8d-b634-e9f145c1ec4b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:24.262715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac515b4b-22f2-4b8d-b634-e9f145c1ec4b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:24.301404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7bbf0-ad0a-4331-be97-7625d7d9c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:24.302075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7bbf0-ad0a-4331-be97-7625d7d9c6be None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:24.302366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7bbf0-ad0a-4331-be97-7625d7d9c6be None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:24.302652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7bbf0-ad0a-4331-be97-7625d7d9c6be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:24.303663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7bbf0-ad0a-4331-be97-7625d7d9c6be None admin] RBAC: Adding query filter params (role.id=627af591fe55445c83abe50f753404c9, scope.project.id=91199bf0cd184c0eb867f99d5018bb1d, user.id=9736248d560340dba1575baeea8ca3ec) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:24.304106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7bbf0-ad0a-4331-be97-7625d7d9c6be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:24.305602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7bbf0-ad0a-4331-be97-7625d7d9c6be None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:24.311815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 46/97] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:24 2022] GET /identity/v3/role_assignments?user.id=9736248d560340dba1575baeea8ca3ec&scope.project.id=91199bf0cd184c0eb867f99d5018bb1d&role.id=627af591fe55445c83abe50f753404c9 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:26.060317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f2da9-4212-4862-ba9b-59cecb555ac1 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:26.061365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f2da9-4212-4862-ba9b-59cecb555ac1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:26.061858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f2da9-4212-4862-ba9b-59cecb555ac1 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:26.063476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 52/98] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:26.069199 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6435d-f510-4bd7-8efb-315fd9d1f2aa None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:26.070051 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6435d-f510-4bd7-8efb-315fd9d1f2aa None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:26.070538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6435d-f510-4bd7-8efb-315fd9d1f2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:26.095941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-a0a6435d-f510-4bd7-8efb-315fd9d1f2aa None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:26.097480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a0a6435d-f510-4bd7-8efb-315fd9d1f2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:26.181998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 47/99] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:26.221686 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f2da9-4212-4862-ba9b-59cecb555ac1 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:26.347502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f2da9-4212-4862-ba9b-59cecb555ac1 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:26.387311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f19b3b-4600-4d10-9ebb-51f7a265f7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:26.388208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f19b3b-4600-4d10-9ebb-51f7a265f7b7 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:26.388495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f19b3b-4600-4d10-9ebb-51f7a265f7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:26.388776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f19b3b-4600-4d10-9ebb-51f7a265f7b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:26.404575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f19b3b-4600-4d10-9ebb-51f7a265f7b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-59f19b3b-4600-4d10-9ebb-51f7a265f7b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:26.412357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:26.413260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:26.414453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 53/100] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:34:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:26.423685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6435d-f510-4bd7-8efb-315fd9d1f2aa None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:26.526721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6435d-f510-4bd7-8efb-315fd9d1f2aa None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:26.567388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca043e52-bd51-40e2-9b24-74abf82ad123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:26.568475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043e52-bd51-40e2-9b24-74abf82ad123 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:26.568971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043e52-bd51-40e2-9b24-74abf82ad123 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:26.569454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043e52-bd51-40e2-9b24-74abf82ad123 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:26.570415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca043e52-bd51-40e2-9b24-74abf82ad123 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:26.570913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca043e52-bd51-40e2-9b24-74abf82ad123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:26.572548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca043e52-bd51-40e2-9b24-74abf82ad123 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:26.587324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 48/101] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:26.589140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f19b3b-4600-4d10-9ebb-51f7a265f7b7 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:26.742097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f19b3b-4600-4d10-9ebb-51f7a265f7b7 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:26.784185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dd81b-4084-44a2-90b8-0b32b4a384a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:26.785002 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd81b-4084-44a2-90b8-0b32b4a384a2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:26.785288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd81b-4084-44a2-90b8-0b32b4a384a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:26.785570 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd81b-4084-44a2-90b8-0b32b4a384a2 None admin] PATH_INFO: `/v3/users/bf98c9865904466fa1a6dd87c28d438c` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:26.786786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dd81b-4084-44a2-90b8-0b32b4a384a2 None admin] RBAC: Authorizing `identity:get_user(user_id=bf98c9865904466fa1a6dd87c28d438c)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:26.788291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dd81b-4084-44a2-90b8-0b32b4a384a2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:26.790015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 54/102] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:26 2022] GET /identity/v3/users/bf98c9865904466fa1a6dd87c28d438c => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:26.796498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca043e52-bd51-40e2-9b24-74abf82ad123 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:26.889250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae861c5-9d54-4666-b8fa-4c13febfed8b None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:26.889598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae861c5-9d54-4666-b8fa-4c13febfed8b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:26.889819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae861c5-9d54-4666-b8fa-4c13febfed8b None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:26.891215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 55/103] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:26.915197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752a6cb-9665-4bcf-9528-49c15759c5ab None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:26.915197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752a6cb-9665-4bcf-9528-49c15759c5ab None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:26.915197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752a6cb-9665-4bcf-9528-49c15759c5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:26.945915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8752a6cb-9665-4bcf-9528-49c15759c5ab None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:26.947147 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8752a6cb-9665-4bcf-9528-49c15759c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:26.991404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca043e52-bd51-40e2-9b24-74abf82ad123 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:27.077085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1739f-f351-44a5-9786-58b1305d37ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:27.084780 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1739f-f351-44a5-9786-58b1305d37ef None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.085070 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1739f-f351-44a5-9786-58b1305d37ef None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.085354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1739f-f351-44a5-9786-58b1305d37ef None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.088230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 56/104] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:27.092483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1739f-f351-44a5-9786-58b1305d37ef None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:27.094223 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1739f-f351-44a5-9786-58b1305d37ef None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:27.096041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 49/105] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:26 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:27.101893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752a6cb-9665-4bcf-9528-49c15759c5ab None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:27.150496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aba59-e9f5-4bdb-b350-acae0ba94ac5 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.150496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aba59-e9f5-4bdb-b350-acae0ba94ac5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.150496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aba59-e9f5-4bdb-b350-acae0ba94ac5 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.150496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 50/106] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:34:27.152073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66401a5-cc26-458f-8c36-6748388f2261 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.152377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66401a5-cc26-458f-8c36-6748388f2261 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.153329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66401a5-cc26-458f-8c36-6748388f2261 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.154906 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 51/107] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:27.160731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66401a5-cc26-458f-8c36-6748388f2261 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:27.220888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752a6cb-9665-4bcf-9528-49c15759c5ab None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:27.258240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54b47d-6e59-4100-99c1-1b48c09da9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:27.259169 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b47d-6e59-4100-99c1-1b48c09da9a3 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.259451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b47d-6e59-4100-99c1-1b48c09da9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.259757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b47d-6e59-4100-99c1-1b48c09da9a3 None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726/users/bf98c9865904466fa1a6dd87c28d438c/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.262187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54b47d-6e59-4100-99c1-1b48c09da9a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0793f1f4e4422f921a1d20504a3726, user_id=bf98c9865904466fa1a6dd87c28d438c, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:27.263691 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54b47d-6e59-4100-99c1-1b48c09da9a3 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:27.268066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66401a5-cc26-458f-8c36-6748388f2261 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:27.281577 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 57/108] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:34:27 2022] PUT /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726/users/bf98c9865904466fa1a6dd87c28d438c/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:34:27.283894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba942e65-59d2-40f0-b85b-23187e17b490 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.284196 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba942e65-59d2-40f0-b85b-23187e17b490 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.284475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba942e65-59d2-40f0-b85b-23187e17b490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.308215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-ba942e65-59d2-40f0-b85b-23187e17b490 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:27.309538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484bfc4-9b10-4db6-9dae-b9501a2a7c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:27.309697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ba942e65-59d2-40f0-b85b-23187e17b490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:27.310561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484bfc4-9b10-4db6-9dae-b9501a2a7c04 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.310948 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484bfc4-9b10-4db6-9dae-b9501a2a7c04 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.311342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484bfc4-9b10-4db6-9dae-b9501a2a7c04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.323772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484bfc4-9b10-4db6-9dae-b9501a2a7c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-b484bfc4-9b10-4db6-9dae-b9501a2a7c04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:27.332855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:27.333878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:27.334848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:27.336901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 52/109] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:34:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:27.342384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73307f41-d17b-4ebe-b14d-0bb71380b67a None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.342384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73307f41-d17b-4ebe-b14d-0bb71380b67a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.342384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73307f41-d17b-4ebe-b14d-0bb71380b67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.357652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-73307f41-d17b-4ebe-b14d-0bb71380b67a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:27.359028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-73307f41-d17b-4ebe-b14d-0bb71380b67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:27.395950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 58/110] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:27.396855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba942e65-59d2-40f0-b85b-23187e17b490 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:27.466107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 53/111] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:27.466826 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73307f41-d17b-4ebe-b14d-0bb71380b67a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:27.519130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba942e65-59d2-40f0-b85b-23187e17b490 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:27.558207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916ffd3-17d0-44f0-b49c-7de5be5de0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:27.559502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916ffd3-17d0-44f0-b49c-7de5be5de0aa None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.560379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916ffd3-17d0-44f0-b49c-7de5be5de0aa None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.560859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916ffd3-17d0-44f0-b49c-7de5be5de0aa None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.562427 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916ffd3-17d0-44f0-b49c-7de5be5de0aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:27.563209 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916ffd3-17d0-44f0-b49c-7de5be5de0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:27.565834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916ffd3-17d0-44f0-b49c-7de5be5de0aa None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:27.577097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 59/112] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:34:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:27.578863 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735ef86-4985-4d83-8570-3efbf03c60c8 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.579334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735ef86-4985-4d83-8570-3efbf03c60c8 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.579611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735ef86-4985-4d83-8570-3efbf03c60c8 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.580889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 60/113] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:27.581647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735ef86-4985-4d83-8570-3efbf03c60c8 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:27.601518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73307f41-d17b-4ebe-b14d-0bb71380b67a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:27.646627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98fb34-9139-4d28-b019-a89a0c78c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:27.647437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98fb34-9139-4d28-b019-a89a0c78c3fe None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.647751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98fb34-9139-4d28-b019-a89a0c78c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.648045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98fb34-9139-4d28-b019-a89a0c78c3fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.659401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98fb34-9139-4d28-b019-a89a0c78c3fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-4b98fb34-9139-4d28-b019-a89a0c78c3fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:27.667365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:27.668333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:27.669278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 54/114] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:27.670469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fdba4-52db-41aa-9576-e9319768c754 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.670469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fdba4-52db-41aa-9576-e9319768c754 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.672079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fdba4-52db-41aa-9576-e9319768c754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.687480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b34fdba4-52db-41aa-9576-e9319768c754 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:27.688702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b34fdba4-52db-41aa-9576-e9319768c754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:27.695479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735ef86-4985-4d83-8570-3efbf03c60c8 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:27.729886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce2024-585d-4ff7-821a-071faafbf704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:27.730778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2024-585d-4ff7-821a-071faafbf704 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.731183 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2024-585d-4ff7-821a-071faafbf704 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.731463 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce2024-585d-4ff7-821a-071faafbf704 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.742280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce2024-585d-4ff7-821a-071faafbf704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-07ce2024-585d-4ff7-821a-071faafbf704 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:27.750816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:27.752896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:27.754970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:27.756510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 55/116] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:27.756669 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 61/116] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:27.763746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fdba4-52db-41aa-9576-e9319768c754 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:27.763986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce2024-585d-4ff7-821a-071faafbf704 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:27.861582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fdba4-52db-41aa-9576-e9319768c754 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:27.861916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce2024-585d-4ff7-821a-071faafbf704 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:27.896802 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cca7a-be44-45f6-b980-51528b58c9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:27.897476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cca7a-be44-45f6-b980-51528b58c9b0 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.897761 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cca7a-be44-45f6-b980-51528b58c9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.897942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8d0ec-c5ec-4185-93f9-68135a604721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:27.898143 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cca7a-be44-45f6-b980-51528b58c9b0 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.898747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8d0ec-c5ec-4185-93f9-68135a604721 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:27.898914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cca7a-be44-45f6-b980-51528b58c9b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:27.899058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8d0ec-c5ec-4185-93f9-68135a604721 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:27.899208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cca7a-be44-45f6-b980-51528b58c9b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:27.899357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8d0ec-c5ec-4185-93f9-68135a604721 None admin] PATH_INFO: `/v3/users/9736248d560340dba1575baeea8ca3ec` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:27.900458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cca7a-be44-45f6-b980-51528b58c9b0 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:27.900628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8d0ec-c5ec-4185-93f9-68135a604721 None admin] RBAC: Authorizing `identity:get_user(user_id=9736248d560340dba1575baeea8ca3ec)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:27.901983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8d0ec-c5ec-4185-93f9-68135a604721 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:27.904635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 56/117] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:27 2022] GET /identity/v3/users/9736248d560340dba1575baeea8ca3ec => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:27.905424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8d0ec-c5ec-4185-93f9-68135a604721 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:27.915521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 62/118] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:27.921300 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cca7a-be44-45f6-b980-51528b58c9b0 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:28.019029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8d0ec-c5ec-4185-93f9-68135a604721 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:28.031930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cca7a-be44-45f6-b980-51528b58c9b0 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:28.060669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cfd35-f68e-4fc3-bb08-199edac78928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:28.061515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfd35-f68e-4fc3-bb08-199edac78928 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.061801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfd35-f68e-4fc3-bb08-199edac78928 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.062071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfd35-f68e-4fc3-bb08-199edac78928 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.062826 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cfd35-f68e-4fc3-bb08-199edac78928 None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:28.063127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cfd35-f68e-4fc3-bb08-199edac78928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:28.064539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cfd35-f68e-4fc3-bb08-199edac78928 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:28.067291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98106f0f-737d-4e5f-a8ea-c7d31c686bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:28.068399 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106f0f-737d-4e5f-a8ea-c7d31c686bb7 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.068925 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106f0f-737d-4e5f-a8ea-c7d31c686bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.069388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106f0f-737d-4e5f-a8ea-c7d31c686bb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.070577 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98106f0f-737d-4e5f-a8ea-c7d31c686bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:28.072117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98106f0f-737d-4e5f-a8ea-c7d31c686bb7 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:28.072695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 57/119] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:28.078636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 63/120] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:28.078636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98106f0f-737d-4e5f-a8ea-c7d31c686bb7 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:28.078896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cfd35-f68e-4fc3-bb08-199edac78928 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:28.175222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98106f0f-737d-4e5f-a8ea-c7d31c686bb7 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:28.176182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cfd35-f68e-4fc3-bb08-199edac78928 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:28.208211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6965230-9a70-4be4-bdf7-ca3c1b62c8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:28.209099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6965230-9a70-4be4-bdf7-ca3c1b62c8b3 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.209210 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a470fe-4541-4736-8395-0d84e01b34b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:28.209396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6965230-9a70-4be4-bdf7-ca3c1b62c8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.209663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6965230-9a70-4be4-bdf7-ca3c1b62c8b3 None admin] PATH_INFO: `/v3/users/b4bf9d1158b94711a0b33eea299777dd` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.210061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a470fe-4541-4736-8395-0d84e01b34b1 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.210346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a470fe-4541-4736-8395-0d84e01b34b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.210625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a470fe-4541-4736-8395-0d84e01b34b1 None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.211834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a470fe-4541-4736-8395-0d84e01b34b1 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:28.213298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a470fe-4541-4736-8395-0d84e01b34b1 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:28.215822 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 58/121] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:28 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:28.216778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3ebf-16fe-4c74-b015-cf375730945c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.217061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3ebf-16fe-4c74-b015-cf375730945c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.217341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad3ebf-16fe-4c74-b015-cf375730945c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.218821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 59/122] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:28.219489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad3ebf-16fe-4c74-b015-cf375730945c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:28.233980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6965230-9a70-4be4-bdf7-ca3c1b62c8b3 None admin] RBAC: Authorizing `identity:get_user(user_id=b4bf9d1158b94711a0b33eea299777dd)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:28.235464 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6965230-9a70-4be4-bdf7-ca3c1b62c8b3 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:28.241871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 64/123] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:28 2022] GET /identity/v3/users/b4bf9d1158b94711a0b33eea299777dd => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:28.241871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6965230-9a70-4be4-bdf7-ca3c1b62c8b3 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:28.320280 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad3ebf-16fe-4c74-b015-cf375730945c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:28.345648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6965230-9a70-4be4-bdf7-ca3c1b62c8b3 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:28.354108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62364904-458a-47cb-b65a-6311a58d5bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:28.354774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364904-458a-47cb-b65a-6311a58d5bcf None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.355061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364904-458a-47cb-b65a-6311a58d5bcf None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.355343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364904-458a-47cb-b65a-6311a58d5bcf None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.356601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62364904-458a-47cb-b65a-6311a58d5bcf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:28.358043 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62364904-458a-47cb-b65a-6311a58d5bcf None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:28.384133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dda91-0120-484d-9ada-771d47ce4cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:28.390719 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 60/124] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:34:28 2022] POST /identity/v3/projects => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:28.390928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dda91-0120-484d-9ada-771d47ce4cb8 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.390928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dda91-0120-484d-9ada-771d47ce4cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.390928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dda91-0120-484d-9ada-771d47ce4cb8 None admin] PATH_INFO: `/v3/users/9736248d560340dba1575baeea8ca3ec` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.391381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62364904-458a-47cb-b65a-6311a58d5bcf None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:28.391484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dda91-0120-484d-9ada-771d47ce4cb8 None admin] RBAC: Authorizing `identity:get_user(user_id=9736248d560340dba1575baeea8ca3ec)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:28.391484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dda91-0120-484d-9ada-771d47ce4cb8 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:28.391484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 65/125] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:28 2022] GET /identity/v3/users/9736248d560340dba1575baeea8ca3ec => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:28.391832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177e86-0184-40b5-9a89-35144a598ef8 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.394375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177e86-0184-40b5-9a89-35144a598ef8 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.394375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177e86-0184-40b5-9a89-35144a598ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.412568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a9177e86-0184-40b5-9a89-35144a598ef8 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:28.413927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a9177e86-0184-40b5-9a89-35144a598ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:28.499346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 66/126] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:28.500308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9177e86-0184-40b5-9a89-35144a598ef8 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:28.534752 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62364904-458a-47cb-b65a-6311a58d5bcf None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:28.581926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efd1d7-e3d0-4499-9f2e-ff9176995d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:28.582869 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efd1d7-e3d0-4499-9f2e-ff9176995d72 None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.583157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efd1d7-e3d0-4499-9f2e-ff9176995d72 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.583437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efd1d7-e3d0-4499-9f2e-ff9176995d72 None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726/users/9736248d560340dba1575baeea8ca3ec/roles/004dfaca095a4141ae157de95aa6390a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.586715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efd1d7-e3d0-4499-9f2e-ff9176995d72 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0793f1f4e4422f921a1d20504a3726, user_id=9736248d560340dba1575baeea8ca3ec, role_id=004dfaca095a4141ae157de95aa6390a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:28.588890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efd1d7-e3d0-4499-9f2e-ff9176995d72 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:28.614773 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 61/127] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:34:28 2022] PUT /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726/users/9736248d560340dba1575baeea8ca3ec/roles/004dfaca095a4141ae157de95aa6390a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:34:28.619503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9177e86-0184-40b5-9a89-35144a598ef8 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:28.620786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efd1d7-e3d0-4499-9f2e-ff9176995d72 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:28.667885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc369237-2a8f-4136-bcc6-7056506d356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:28.668883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc369237-2a8f-4136-bcc6-7056506d356d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.669238 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc369237-2a8f-4136-bcc6-7056506d356d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.669439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc369237-2a8f-4136-bcc6-7056506d356d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.766487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efd1d7-e3d0-4499-9f2e-ff9176995d72 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:28.770623 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc369237-2a8f-4136-bcc6-7056506d356d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:28.772503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc369237-2a8f-4136-bcc6-7056506d356d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:28.802982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce992a-ff8e-4186-8b9a-ac2daf08e510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:28.803969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce992a-ff8e-4186-8b9a-ac2daf08e510 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.804263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce992a-ff8e-4186-8b9a-ac2daf08e510 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.804505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce992a-ff8e-4186-8b9a-ac2daf08e510 None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.805779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce992a-ff8e-4186-8b9a-ac2daf08e510 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:28.807328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce992a-ff8e-4186-8b9a-ac2daf08e510 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:28.810317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 62/128] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:28 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:28.811253 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce992a-ff8e-4186-8b9a-ac2daf08e510 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:28.883700 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 67/129] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:28.884568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc369237-2a8f-4136-bcc6-7056506d356d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:28.919746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce992a-ff8e-4186-8b9a-ac2daf08e510 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:28.953409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d8b2a-8a95-4072-8dd2-9f1fb78eb6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:28.954212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d8b2a-8a95-4072-8dd2-9f1fb78eb6b1 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:28.954495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d8b2a-8a95-4072-8dd2-9f1fb78eb6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:28.954769 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d8b2a-8a95-4072-8dd2-9f1fb78eb6b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:28.965394 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d8b2a-8a95-4072-8dd2-9f1fb78eb6b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-5d7d8b2a-8a95-4072-8dd2-9f1fb78eb6b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:28.973862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:28.974739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 63/130] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:28.975963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d8b2a-8a95-4072-8dd2-9f1fb78eb6b1 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:29.009846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc369237-2a8f-4136-bcc6-7056506d356d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:29.050084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336c27e-d771-441e-bd5c-543460a1b27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:29.050970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336c27e-d771-441e-bd5c-543460a1b27e None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:29.051253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336c27e-d771-441e-bd5c-543460a1b27e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:29.051529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336c27e-d771-441e-bd5c-543460a1b27e None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726/users/9736248d560340dba1575baeea8ca3ec/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:29.053675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336c27e-d771-441e-bd5c-543460a1b27e None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0793f1f4e4422f921a1d20504a3726, user_id=9736248d560340dba1575baeea8ca3ec, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:29.055138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336c27e-d771-441e-bd5c-543460a1b27e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:29.086082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 68/131] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:34:28 2022] PUT /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726/users/9736248d560340dba1575baeea8ca3ec/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:34:29.086943 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336c27e-d771-441e-bd5c-543460a1b27e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:29.092122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d8b2a-8a95-4072-8dd2-9f1fb78eb6b1 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:29.129101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f5c6-95be-4415-9033-d33356d5b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:29.129979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f5c6-95be-4415-9033-d33356d5b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:29.130262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f5c6-95be-4415-9033-d33356d5b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:29.130543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f5c6-95be-4415-9033-d33356d5b4a7 None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:29.131805 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37f5c6-95be-4415-9033-d33356d5b4a7 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:29.133348 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37f5c6-95be-4415-9033-d33356d5b4a7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:29.135431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 64/132] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:28 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:29.141542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f5c6-95be-4415-9033-d33356d5b4a7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:29.248032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f5c6-95be-4415-9033-d33356d5b4a7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:29.284199 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53b2a-976a-44d1-8534-b7b182934647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:29.284915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53b2a-976a-44d1-8534-b7b182934647 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:29.285201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53b2a-976a-44d1-8534-b7b182934647 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:29.285483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53b2a-976a-44d1-8534-b7b182934647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:29.286336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53b2a-976a-44d1-8534-b7b182934647 None admin] RBAC: Adding query filter params (role.id=0566c059f03f4e44b3a4bad9cdba3cdc, scope.project.id=3c0793f1f4e4422f921a1d20504a3726, user.id=b4bf9d1158b94711a0b33eea299777dd) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:29.286650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53b2a-976a-44d1-8534-b7b182934647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:29.288263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53b2a-976a-44d1-8534-b7b182934647 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:29.295283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 65/133] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:29 2022] GET /identity/v3/role_assignments?user.id=b4bf9d1158b94711a0b33eea299777dd&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=0566c059f03f4e44b3a4bad9cdba3cdc => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:29.336171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336c27e-d771-441e-bd5c-543460a1b27e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:29.395053 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b4439-5076-4532-be9d-b09dca6bbf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:29.395792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4439-5076-4532-be9d-b09dca6bbf8d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:29.396086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4439-5076-4532-be9d-b09dca6bbf8d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:29.396373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4439-5076-4532-be9d-b09dca6bbf8d None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:29.397168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b4439-5076-4532-be9d-b09dca6bbf8d None admin] RBAC: Adding query filter params (name=member) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:29.397478 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b4439-5076-4532-be9d-b09dca6bbf8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:29.399080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b4439-5076-4532-be9d-b09dca6bbf8d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:29.409700 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 69/134] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:29.415909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53b2a-976a-44d1-8534-b7b182934647 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:29.548873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53b2a-976a-44d1-8534-b7b182934647 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:29.585635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a8cb2-d6f8-49b5-b961-90614b7a0e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:29.586594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a8cb2-d6f8-49b5-b961-90614b7a0e8c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:29.586836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a8cb2-d6f8-49b5-b961-90614b7a0e8c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:29.587117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a8cb2-d6f8-49b5-b961-90614b7a0e8c None admin] PATH_INFO: `/v3/users/9736248d560340dba1575baeea8ca3ec` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:29.588382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a8cb2-d6f8-49b5-b961-90614b7a0e8c None admin] RBAC: Authorizing `identity:get_user(user_id=9736248d560340dba1575baeea8ca3ec)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:29.589862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a8cb2-d6f8-49b5-b961-90614b7a0e8c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:29.592011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 66/135] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:29 2022] GET /identity/v3/users/9736248d560340dba1575baeea8ca3ec => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:29.597884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b4439-5076-4532-be9d-b09dca6bbf8d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:29.701973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b4439-5076-4532-be9d-b09dca6bbf8d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:29.743317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2402f-fd75-4843-8e44-8b95a1902953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:29.744532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2402f-fd75-4843-8e44-8b95a1902953 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:29.744960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2402f-fd75-4843-8e44-8b95a1902953 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:29.745382 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2402f-fd75-4843-8e44-8b95a1902953 None admin] PATH_INFO: `/v3/projects/91199bf0cd184c0eb867f99d5018bb1d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:29.746885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2402f-fd75-4843-8e44-8b95a1902953 None admin] RBAC: Authorizing `identity:get_project(project_id=91199bf0cd184c0eb867f99d5018bb1d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:29.748530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2402f-fd75-4843-8e44-8b95a1902953 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:29.750428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 70/136] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:29 2022] GET /identity/v3/projects/91199bf0cd184c0eb867f99d5018bb1d => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:29.764934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a8cb2-d6f8-49b5-b961-90614b7a0e8c None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:29.891005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a8cb2-d6f8-49b5-b961-90614b7a0e8c None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:29.936957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc95af0-0e90-458b-87a8-de58293f9a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:29.937878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc95af0-0e90-458b-87a8-de58293f9a5a None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:29.938168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc95af0-0e90-458b-87a8-de58293f9a5a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:29.938455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc95af0-0e90-458b-87a8-de58293f9a5a None admin] PATH_INFO: `/v3/projects/91199bf0cd184c0eb867f99d5018bb1d/users/9736248d560340dba1575baeea8ca3ec/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:29.940507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc95af0-0e90-458b-87a8-de58293f9a5a None admin] RBAC: Authorizing `identity:create_grant(project_id=91199bf0cd184c0eb867f99d5018bb1d, user_id=9736248d560340dba1575baeea8ca3ec, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:29.941975 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc95af0-0e90-458b-87a8-de58293f9a5a None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:29.973443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 67/137] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:34:29 2022] PUT /identity/v3/projects/91199bf0cd184c0eb867f99d5018bb1d/users/9736248d560340dba1575baeea8ca3ec/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:34:30.058193 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41614f29-4058-43c1-85ee-12a7412ad4f3 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:30.058513 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41614f29-4058-43c1-85ee-12a7412ad4f3 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:30.059409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41614f29-4058-43c1-85ee-12a7412ad4f3 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:30.061056 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 71/138] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:30.067140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ea2cd-d726-41c5-85d3-98e3fee6496f None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:30.067438 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ea2cd-d726-41c5-85d3-98e3fee6496f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:30.067745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ea2cd-d726-41c5-85d3-98e3fee6496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:30.089289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-ad2ea2cd-d726-41c5-85d3-98e3fee6496f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:30.090832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ad2ea2cd-d726-41c5-85d3-98e3fee6496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:30.178781 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 68/139] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:30.213595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41614f29-4058-43c1-85ee-12a7412ad4f3 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:30.336485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41614f29-4058-43c1-85ee-12a7412ad4f3 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:30.378795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98377c7b-4614-442d-bb82-dc88664725ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:30.379623 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98377c7b-4614-442d-bb82-dc88664725ac None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:30.379951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98377c7b-4614-442d-bb82-dc88664725ac None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:30.380230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98377c7b-4614-442d-bb82-dc88664725ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:30.397105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98377c7b-4614-442d-bb82-dc88664725ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-98377c7b-4614-442d-bb82-dc88664725ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:30.405729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:30.406607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:30.407347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 72/140] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:34:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:30.414858 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ea2cd-d726-41c5-85d3-98e3fee6496f None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:30.519586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ea2cd-d726-41c5-85d3-98e3fee6496f None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:30.559657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b1903-8dde-401a-af6a-11e78772fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:30.560378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b1903-8dde-401a-af6a-11e78772fe43 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:30.560657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b1903-8dde-401a-af6a-11e78772fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:30.560943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b1903-8dde-401a-af6a-11e78772fe43 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:30.561715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b1903-8dde-401a-af6a-11e78772fe43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:30.562025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b1903-8dde-401a-af6a-11e78772fe43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:30.563417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b1903-8dde-401a-af6a-11e78772fe43 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:30.578274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 69/141] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:30.583760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98377c7b-4614-442d-bb82-dc88664725ac None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:30.713380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98377c7b-4614-442d-bb82-dc88664725ac None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:30.754823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e93aa-08a6-4915-a306-7f7dbcb3b04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:30.755725 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e93aa-08a6-4915-a306-7f7dbcb3b04c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:30.756018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e93aa-08a6-4915-a306-7f7dbcb3b04c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:30.756297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e93aa-08a6-4915-a306-7f7dbcb3b04c None admin] PATH_INFO: `/v3/users/bf98c9865904466fa1a6dd87c28d438c` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:30.757533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e93aa-08a6-4915-a306-7f7dbcb3b04c None admin] RBAC: Authorizing `identity:get_user(user_id=bf98c9865904466fa1a6dd87c28d438c)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:30.758995 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e93aa-08a6-4915-a306-7f7dbcb3b04c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:30.760974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 73/142] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:30 2022] GET /identity/v3/users/bf98c9865904466fa1a6dd87c28d438c => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:30.766996 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b1903-8dde-401a-af6a-11e78772fe43 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:30.925535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b1903-8dde-401a-af6a-11e78772fe43 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:30.967762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bdf06-869e-45d6-9b8c-e484a16780c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:30.968681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bdf06-869e-45d6-9b8c-e484a16780c0 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:30.968971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bdf06-869e-45d6-9b8c-e484a16780c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:30.969250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bdf06-869e-45d6-9b8c-e484a16780c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:31.056387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bdf06-869e-45d6-9b8c-e484a16780c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:31.057882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bdf06-869e-45d6-9b8c-e484a16780c0 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:31.159798 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 70/143] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:31.165718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e93aa-08a6-4915-a306-7f7dbcb3b04c None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:31.273239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e93aa-08a6-4915-a306-7f7dbcb3b04c None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:31.314884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc2965-2459-46d4-8ff8-036c2ffdb85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:31.315801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc2965-2459-46d4-8ff8-036c2ffdb85e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:31.316096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc2965-2459-46d4-8ff8-036c2ffdb85e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:31.316378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc2965-2459-46d4-8ff8-036c2ffdb85e None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:31.317609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc2965-2459-46d4-8ff8-036c2ffdb85e None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:31.319078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc2965-2459-46d4-8ff8-036c2ffdb85e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:31.321053 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 74/144] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:31 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:31.328102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bdf06-869e-45d6-9b8c-e484a16780c0 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:31.475539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bdf06-869e-45d6-9b8c-e484a16780c0 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:31.517274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e32ff-240b-4049-9426-bc97a7caea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:31.517939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e32ff-240b-4049-9426-bc97a7caea8a None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:31.518220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e32ff-240b-4049-9426-bc97a7caea8a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:31.518495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e32ff-240b-4049-9426-bc97a7caea8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:31.519334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e32ff-240b-4049-9426-bc97a7caea8a None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=3c0793f1f4e4422f921a1d20504a3726, user.id=bf98c9865904466fa1a6dd87c28d438c) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:31.519645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e32ff-240b-4049-9426-bc97a7caea8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:31.521145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e32ff-240b-4049-9426-bc97a7caea8a None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:31.532619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 71/145] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:31 2022] GET /identity/v3/role_assignments?user.id=bf98c9865904466fa1a6dd87c28d438c&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=b104fd2e772843a0974990f965d8b589 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:32.160229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96dc1-1455-46a7-b523-cff4fb9e697a None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:32.160229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96dc1-1455-46a7-b523-cff4fb9e697a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:32.160229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96dc1-1455-46a7-b523-cff4fb9e697a None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:32.160229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 75/146] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:32.167444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdebe64-fcb5-4cd7-add9-efc4d22f4462 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:32.167822 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdebe64-fcb5-4cd7-add9-efc4d22f4462 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:32.168128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdebe64-fcb5-4cd7-add9-efc4d22f4462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:32.197157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-fcdebe64-fcb5-4cd7-add9-efc4d22f4462 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:32.198253 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-fcdebe64-fcb5-4cd7-add9-efc4d22f4462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:32.278816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 72/147] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:32.314766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc96dc1-1455-46a7-b523-cff4fb9e697a None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:32.383672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3105498-1ae1-48ab-b389-9298f0428e09 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:32.384208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3105498-1ae1-48ab-b389-9298f0428e09 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:32.384306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3105498-1ae1-48ab-b389-9298f0428e09 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:32.385749 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 73/148] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:34:32.391197 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6f719-e1b0-4376-b67e-6a2e11c2d35d None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:32.391486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6f719-e1b0-4376-b67e-6a2e11c2d35d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:32.391828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6f719-e1b0-4376-b67e-6a2e11c2d35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:32.418403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-c0a6f719-e1b0-4376-b67e-6a2e11c2d35d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:32.419794 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c0a6f719-e1b0-4376-b67e-6a2e11c2d35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:32.457583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc96dc1-1455-46a7-b523-cff4fb9e697a None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:32.508448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee5ced-48de-4ba6-a153-48de168e83fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:32.509291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5ced-48de-4ba6-a153-48de168e83fd None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:32.509578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5ced-48de-4ba6-a153-48de168e83fd None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:32.509858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5ced-48de-4ba6-a153-48de168e83fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:32.519841 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 74/149] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:32.523449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee5ced-48de-4ba6-a153-48de168e83fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-4bee5ced-48de-4ba6-a153-48de168e83fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:32.532462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:32.533353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:32.534569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 76/150] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:34:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:32.539307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6f719-e1b0-4376-b67e-6a2e11c2d35d None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:32.553296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee5ced-48de-4ba6-a153-48de168e83fd None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:32.708078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee5ced-48de-4ba6-a153-48de168e83fd None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:32.742451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b66dc2-8c69-4026-b6cf-e44ba4ae94e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:32.743271 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66dc2-8c69-4026-b6cf-e44ba4ae94e4 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:32.743558 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66dc2-8c69-4026-b6cf-e44ba4ae94e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:32.743869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b66dc2-8c69-4026-b6cf-e44ba4ae94e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:32.745393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b66dc2-8c69-4026-b6cf-e44ba4ae94e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:32.747457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b66dc2-8c69-4026-b6cf-e44ba4ae94e4 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:32.749966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 77/151] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:32.755073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b66dc2-8c69-4026-b6cf-e44ba4ae94e4 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:32.756187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6f719-e1b0-4376-b67e-6a2e11c2d35d None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:32.820061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b473724-3b42-422f-a113-1c65ceea6f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:32.821125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b473724-3b42-422f-a113-1c65ceea6f19 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:32.821646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b473724-3b42-422f-a113-1c65ceea6f19 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:32.822124 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b473724-3b42-422f-a113-1c65ceea6f19 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:32.823125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b473724-3b42-422f-a113-1c65ceea6f19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:32.823613 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b473724-3b42-422f-a113-1c65ceea6f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:32.825832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b473724-3b42-422f-a113-1c65ceea6f19 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:32.834382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 75/152] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:34:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:32.836043 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84882a-df8d-48d1-ab99-0961b1e51710 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:32.836578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84882a-df8d-48d1-ab99-0961b1e51710 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:32.837054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84882a-df8d-48d1-ab99-0961b1e51710 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:32.838799 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 76/153] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:32.839841 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84882a-df8d-48d1-ab99-0961b1e51710 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:32.871209 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b66dc2-8c69-4026-b6cf-e44ba4ae94e4 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:32.906653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dbf26-8a5a-4de7-a4c7-f778a2c53bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:32.907338 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dbf26-8a5a-4de7-a4c7-f778a2c53bd8 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:32.907625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dbf26-8a5a-4de7-a4c7-f778a2c53bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:32.907940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dbf26-8a5a-4de7-a4c7-f778a2c53bd8 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:32.908663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dbf26-8a5a-4de7-a4c7-f778a2c53bd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:32.911884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dbf26-8a5a-4de7-a4c7-f778a2c53bd8 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:32.930702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 78/154] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:34:32 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:32.933223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17081b9a-0ed9-42b0-a1a9-78b06b99dc0e None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:32.933517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17081b9a-0ed9-42b0-a1a9-78b06b99dc0e None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:32.934364 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17081b9a-0ed9-42b0-a1a9-78b06b99dc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:32.959344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-17081b9a-0ed9-42b0-a1a9-78b06b99dc0e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:32.960954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-17081b9a-0ed9-42b0-a1a9-78b06b99dc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:32.967887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84882a-df8d-48d1-ab99-0961b1e51710 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:33.019833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e9a8-56f1-44dd-957d-964a128e2fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:33.020799 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e9a8-56f1-44dd-957d-964a128e2fa2 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:33.021142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e9a8-56f1-44dd-957d-964a128e2fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:33.021424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e9a8-56f1-44dd-957d-964a128e2fa2 None admin] PATH_INFO: `/v3/users/9736248d560340dba1575baeea8ca3ec` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:33.022951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e9a8-56f1-44dd-957d-964a128e2fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=9736248d560340dba1575baeea8ca3ec)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:33.024810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e9a8-56f1-44dd-957d-964a128e2fa2 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:33.027291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 77/155] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:32 2022] GET /identity/v3/users/9736248d560340dba1575baeea8ca3ec => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:33.027291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ed2b-d4b7-4e48-bb7f-164c3723a07a None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:33.027291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ed2b-d4b7-4e48-bb7f-164c3723a07a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:33.027291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ed2b-d4b7-4e48-bb7f-164c3723a07a None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:33.027291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 78/156] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:33.036976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6ed2b-d4b7-4e48-bb7f-164c3723a07a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:33.051834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 79/157] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:33.053296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78383034-463f-466d-b729-8e42a68d8299 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:33.053479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78383034-463f-466d-b729-8e42a68d8299 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:33.053905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78383034-463f-466d-b729-8e42a68d8299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:33.071725 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-78383034-463f-466d-b729-8e42a68d8299 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:33.073048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-78383034-463f-466d-b729-8e42a68d8299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:33.151430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 80/158] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:33.152942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9210c62-507f-4f7b-abf0-e692c0616993 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:33.153230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9210c62-507f-4f7b-abf0-e692c0616993 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:33.153695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9210c62-507f-4f7b-abf0-e692c0616993 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:33.155132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 81/159] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:33.156455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6ed2b-d4b7-4e48-bb7f-164c3723a07a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:33.159743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9210c62-507f-4f7b-abf0-e692c0616993 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:33.200578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369848c-bef5-45e3-87b2-f6a05a4d846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:33.201593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369848c-bef5-45e3-87b2-f6a05a4d846d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:33.201947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369848c-bef5-45e3-87b2-f6a05a4d846d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:33.202293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369848c-bef5-45e3-87b2-f6a05a4d846d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:33.290201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369848c-bef5-45e3-87b2-f6a05a4d846d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:33.291592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369848c-bef5-45e3-87b2-f6a05a4d846d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:33.292677 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9210c62-507f-4f7b-abf0-e692c0616993 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:33.339612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7b9b4-800d-40be-8700-a4a5b449580f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:33.341348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b9b4-800d-40be-8700-a4a5b449580f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:33.341540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b9b4-800d-40be-8700-a4a5b449580f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:33.342000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b9b4-800d-40be-8700-a4a5b449580f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:33.354270 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7b9b4-800d-40be-8700-a4a5b449580f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-d1e7b9b4-800d-40be-8700-a4a5b449580f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:33.363256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:33.364287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:33.365094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:33.365662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 82/160] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:33.367319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2ebdf-f0e8-4dbd-8636-5aaceccff1b4 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:33.367610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2ebdf-f0e8-4dbd-8636-5aaceccff1b4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:33.367914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2ebdf-f0e8-4dbd-8636-5aaceccff1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:33.390051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-84e2ebdf-f0e8-4dbd-8636-5aaceccff1b4 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:33.392654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-84e2ebdf-f0e8-4dbd-8636-5aaceccff1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:33.426389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 79/161] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:34:33.427394 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369848c-bef5-45e3-87b2-f6a05a4d846d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:33.483072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 83/162] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:33.484635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2ebdf-f0e8-4dbd-8636-5aaceccff1b4 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:33.545865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369848c-bef5-45e3-87b2-f6a05a4d846d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:33.581272 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a5ce4-6dd0-43fa-bb9d-6a6d86a1130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:33.582076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5ce4-6dd0-43fa-bb9d-6a6d86a1130b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:33.582357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5ce4-6dd0-43fa-bb9d-6a6d86a1130b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:33.582638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5ce4-6dd0-43fa-bb9d-6a6d86a1130b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:33.599765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a5ce4-6dd0-43fa-bb9d-6a6d86a1130b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-293a5ce4-6dd0-43fa-bb9d-6a6d86a1130b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:33.609045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:33.610159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:33.611026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 80/163] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:33.611666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a5ce4-6dd0-43fa-bb9d-6a6d86a1130b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:33.631147 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2ebdf-f0e8-4dbd-8636-5aaceccff1b4 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:33.731159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a5ce4-6dd0-43fa-bb9d-6a6d86a1130b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:33.736971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f156-ca97-43f6-97e3-d32df5ed3018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:33.737665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f156-ca97-43f6-97e3-d32df5ed3018 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:33.737947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f156-ca97-43f6-97e3-d32df5ed3018 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:33.738223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f156-ca97-43f6-97e3-d32df5ed3018 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:33.738992 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585f156-ca97-43f6-97e3-d32df5ed3018 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:33.739297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585f156-ca97-43f6-97e3-d32df5ed3018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:33.740728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585f156-ca97-43f6-97e3-d32df5ed3018 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:33.759023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 84/164] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:33.759826 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f156-ca97-43f6-97e3-d32df5ed3018 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:33.774154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064829a-cb7b-471f-a630-b8dc933bdc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:33.775033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064829a-cb7b-471f-a630-b8dc933bdc9d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:33.775318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064829a-cb7b-471f-a630-b8dc933bdc9d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:33.775594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064829a-cb7b-471f-a630-b8dc933bdc9d None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:33.779446 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064829a-cb7b-471f-a630-b8dc933bdc9d None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:33.781014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064829a-cb7b-471f-a630-b8dc933bdc9d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:33.782738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 81/165] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:33 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:33.783505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064829a-cb7b-471f-a630-b8dc933bdc9d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:33.894309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f156-ca97-43f6-97e3-d32df5ed3018 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:33.952186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16259599-5fcd-4087-b24f-a1fdcd380c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:33.952999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259599-5fcd-4087-b24f-a1fdcd380c2d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:33.953277 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259599-5fcd-4087-b24f-a1fdcd380c2d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:33.953551 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259599-5fcd-4087-b24f-a1fdcd380c2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:33.980340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16259599-5fcd-4087-b24f-a1fdcd380c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-16259599-5fcd-4087-b24f-a1fdcd380c2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:33.988206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:33.989086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:33.989857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 85/166] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:33.996960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16259599-5fcd-4087-b24f-a1fdcd380c2d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:34.009138 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064829a-cb7b-471f-a630-b8dc933bdc9d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:34.052448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b069a2-63b5-4833-a691-9af6b057cddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:34.053131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b069a2-63b5-4833-a691-9af6b057cddc None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:34.053414 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b069a2-63b5-4833-a691-9af6b057cddc None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:34.053691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b069a2-63b5-4833-a691-9af6b057cddc None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:34.054455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b069a2-63b5-4833-a691-9af6b057cddc None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:34.054763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b069a2-63b5-4833-a691-9af6b057cddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:34.056194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b069a2-63b5-4833-a691-9af6b057cddc None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:34.076065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 82/167] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:34.078252 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b069a2-63b5-4833-a691-9af6b057cddc None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:34.172474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16259599-5fcd-4087-b24f-a1fdcd380c2d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:34.230893 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b069a2-63b5-4833-a691-9af6b057cddc None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:34.233455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2806d-5654-4bf4-babe-e14312fab39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:34.239733 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2806d-5654-4bf4-babe-e14312fab39d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:34.240286 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2806d-5654-4bf4-babe-e14312fab39d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:34.240772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2806d-5654-4bf4-babe-e14312fab39d None admin] PATH_INFO: `/v3/users/b4bf9d1158b94711a0b33eea299777dd` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:34.242242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2806d-5654-4bf4-babe-e14312fab39d None admin] RBAC: Authorizing `identity:get_user(user_id=b4bf9d1158b94711a0b33eea299777dd)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:34.243976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2806d-5654-4bf4-babe-e14312fab39d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:34.245824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 86/168] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:33 2022] GET /identity/v3/users/b4bf9d1158b94711a0b33eea299777dd => generated 289 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:34.246939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2806d-5654-4bf4-babe-e14312fab39d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:34.276982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867cc69-7a03-4cbe-a566-838ca1c7ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:34.277767 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867cc69-7a03-4cbe-a566-838ca1c7ac63 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:34.278208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867cc69-7a03-4cbe-a566-838ca1c7ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:34.278316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867cc69-7a03-4cbe-a566-838ca1c7ac63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:34.279159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867cc69-7a03-4cbe-a566-838ca1c7ac63 None admin] RBAC: Adding query filter params (role.id=004dfaca095a4141ae157de95aa6390a, scope.project.id=3c0793f1f4e4422f921a1d20504a3726, user.id=9736248d560340dba1575baeea8ca3ec) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:34.279480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867cc69-7a03-4cbe-a566-838ca1c7ac63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:34.281057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867cc69-7a03-4cbe-a566-838ca1c7ac63 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:34.287269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 83/169] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:34 2022] GET /identity/v3/role_assignments?user.id=9736248d560340dba1575baeea8ca3ec&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=004dfaca095a4141ae157de95aa6390a => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:34.294191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867cc69-7a03-4cbe-a566-838ca1c7ac63 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:34.406620 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2806d-5654-4bf4-babe-e14312fab39d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:34.477158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bdfd6-7a79-42c4-bb63-a4b97141977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:34.478903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bdfd6-7a79-42c4-bb63-a4b97141977f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:34.479549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bdfd6-7a79-42c4-bb63-a4b97141977f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:34.481815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bdfd6-7a79-42c4-bb63-a4b97141977f None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:34.482897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bdfd6-7a79-42c4-bb63-a4b97141977f None admin] RBAC: Adding query filter params (name=member) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:34.483409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bdfd6-7a79-42c4-bb63-a4b97141977f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:34.486177 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bdfd6-7a79-42c4-bb63-a4b97141977f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:34.490669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867cc69-7a03-4cbe-a566-838ca1c7ac63 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:34.510207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 87/170] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:34.510946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bdfd6-7a79-42c4-bb63-a4b97141977f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:34.545183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028b6f1-e84d-4261-8b80-dc070813774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:34.546481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b6f1-e84d-4261-8b80-dc070813774f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:34.548215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b6f1-e84d-4261-8b80-dc070813774f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:34.550116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028b6f1-e84d-4261-8b80-dc070813774f None admin] PATH_INFO: `/v3/users/9736248d560340dba1575baeea8ca3ec` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:34.552945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028b6f1-e84d-4261-8b80-dc070813774f None admin] RBAC: Authorizing `identity:get_user(user_id=9736248d560340dba1575baeea8ca3ec)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:34.554678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028b6f1-e84d-4261-8b80-dc070813774f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:34.560567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 84/171] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:34 2022] GET /identity/v3/users/9736248d560340dba1575baeea8ca3ec => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:34.563123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028b6f1-e84d-4261-8b80-dc070813774f None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:34.719265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028b6f1-e84d-4261-8b80-dc070813774f None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:34.735343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bdfd6-7a79-42c4-bb63-a4b97141977f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:34.772178 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcb7ed-0a55-48f3-aae9-f46bfa11b328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:34.773063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcb7ed-0a55-48f3-aae9-f46bfa11b328 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:34.773344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcb7ed-0a55-48f3-aae9-f46bfa11b328 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:34.773615 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcb7ed-0a55-48f3-aae9-f46bfa11b328 None admin] PATH_INFO: `/v3/users/9736248d560340dba1575baeea8ca3ec` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:34.775393 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcb7ed-0a55-48f3-aae9-f46bfa11b328 None admin] RBAC: Authorizing `identity:get_user(user_id=9736248d560340dba1575baeea8ca3ec)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:34.777077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcb7ed-0a55-48f3-aae9-f46bfa11b328 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:34.780888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 85/172] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:34 2022] GET /identity/v3/users/9736248d560340dba1575baeea8ca3ec => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:34.781693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcb7ed-0a55-48f3-aae9-f46bfa11b328 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:34.797454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ecf2d-405e-45d5-8b0f-48b9a10237d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:34.798342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ecf2d-405e-45d5-8b0f-48b9a10237d2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:34.798626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ecf2d-405e-45d5-8b0f-48b9a10237d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:34.798903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ecf2d-405e-45d5-8b0f-48b9a10237d2 None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:34.804102 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ecf2d-405e-45d5-8b0f-48b9a10237d2 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:34.805588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ecf2d-405e-45d5-8b0f-48b9a10237d2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:34.807912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 88/173] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:34 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:34.808750 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ecf2d-405e-45d5-8b0f-48b9a10237d2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:34.890646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcb7ed-0a55-48f3-aae9-f46bfa11b328 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:34.930708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40299ca-9416-4379-95b3-51c424b61470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:34.931372 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40299ca-9416-4379-95b3-51c424b61470 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:34.931654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40299ca-9416-4379-95b3-51c424b61470 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:34.931954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40299ca-9416-4379-95b3-51c424b61470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:35.031814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ecf2d-405e-45d5-8b0f-48b9a10237d2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:35.032083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40299ca-9416-4379-95b3-51c424b61470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:35.034406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40299ca-9416-4379-95b3-51c424b61470 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:35.079351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736da27-480d-491d-a9c6-ab98d33fef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:35.080400 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736da27-480d-491d-a9c6-ab98d33fef33 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:35.080888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736da27-480d-491d-a9c6-ab98d33fef33 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:35.081385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736da27-480d-491d-a9c6-ab98d33fef33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:35.143735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 86/174] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:35.143735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40299ca-9416-4379-95b3-51c424b61470 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:35.182857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736da27-480d-491d-a9c6-ab98d33fef33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:35.184837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736da27-480d-491d-a9c6-ab98d33fef33 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:35.237830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40299ca-9416-4379-95b3-51c424b61470 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:35.292519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac02a95-f253-4050-991a-fadbe457f1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:35.293890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac02a95-f253-4050-991a-fadbe457f1df None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:35.294162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac02a95-f253-4050-991a-fadbe457f1df None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:35.294437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac02a95-f253-4050-991a-fadbe457f1df None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726/users/b4bf9d1158b94711a0b33eea299777dd/roles/0566c059f03f4e44b3a4bad9cdba3cdc` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:35.301127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac02a95-f253-4050-991a-fadbe457f1df None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0793f1f4e4422f921a1d20504a3726, user_id=b4bf9d1158b94711a0b33eea299777dd, role_id=0566c059f03f4e44b3a4bad9cdba3cdc)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:35.302577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac02a95-f253-4050-991a-fadbe457f1df None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:35.320522 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 89/175] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:35.321772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736da27-480d-491d-a9c6-ab98d33fef33 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:35.338012 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 87/176] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:34:35 2022] PUT /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726/users/b4bf9d1158b94711a0b33eea299777dd/roles/0566c059f03f4e44b3a4bad9cdba3cdc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:34:35.338792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac02a95-f253-4050-991a-fadbe457f1df None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:35.443333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736da27-480d-491d-a9c6-ab98d33fef33 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:35.481308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327f75-a05f-4186-ba0f-8865a0c8920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:35.482606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327f75-a05f-4186-ba0f-8865a0c8920e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:35.483141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327f75-a05f-4186-ba0f-8865a0c8920e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:35.483645 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327f75-a05f-4186-ba0f-8865a0c8920e None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:35.485225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78327f75-a05f-4186-ba0f-8865a0c8920e None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:35.486912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78327f75-a05f-4186-ba0f-8865a0c8920e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:35.488917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 90/177] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:35 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:35.495538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327f75-a05f-4186-ba0f-8865a0c8920e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:35.534028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac02a95-f253-4050-991a-fadbe457f1df None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:35.640409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35ffc-0215-494b-8ab6-ab33e05658cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:35.641292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35ffc-0215-494b-8ab6-ab33e05658cf None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:35.641573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35ffc-0215-494b-8ab6-ab33e05658cf None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:35.641852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35ffc-0215-494b-8ab6-ab33e05658cf None admin] PATH_INFO: `/v3/projects/91199bf0cd184c0eb867f99d5018bb1d` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:35.643626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327f75-a05f-4186-ba0f-8865a0c8920e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:35.647679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca35ffc-0215-494b-8ab6-ab33e05658cf None admin] RBAC: Authorizing `identity:get_project(project_id=91199bf0cd184c0eb867f99d5018bb1d)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:35.649183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca35ffc-0215-494b-8ab6-ab33e05658cf None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:35.650953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 88/178] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:35 2022] GET /identity/v3/projects/91199bf0cd184c0eb867f99d5018bb1d => generated 312 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:35.657592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35ffc-0215-494b-8ab6-ab33e05658cf None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:35.685245 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09ed0a-a0ab-4267-b5b2-f20675c1f919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:35.686325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09ed0a-a0ab-4267-b5b2-f20675c1f919 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:35.686684 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09ed0a-a0ab-4267-b5b2-f20675c1f919 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:35.687032 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09ed0a-a0ab-4267-b5b2-f20675c1f919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:35.688191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09ed0a-a0ab-4267-b5b2-f20675c1f919 None admin] RBAC: Adding query filter params (role.id=627af591fe55445c83abe50f753404c9, scope.project.id=3c0793f1f4e4422f921a1d20504a3726, user.id=9736248d560340dba1575baeea8ca3ec) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:35.688573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09ed0a-a0ab-4267-b5b2-f20675c1f919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:35.690486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09ed0a-a0ab-4267-b5b2-f20675c1f919 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:35.698122 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 91/179] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:35 2022] GET /identity/v3/role_assignments?user.id=9736248d560340dba1575baeea8ca3ec&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=627af591fe55445c83abe50f753404c9 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:35.835015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35ffc-0215-494b-8ab6-ab33e05658cf None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:35.882191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d449b-aeb7-49e8-be8b-445e7c73657b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:35.883298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d449b-aeb7-49e8-be8b-445e7c73657b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:35.883846 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d449b-aeb7-49e8-be8b-445e7c73657b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:35.884305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d449b-aeb7-49e8-be8b-445e7c73657b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:35.885376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d449b-aeb7-49e8-be8b-445e7c73657b None admin] RBAC: Adding query filter params (role.id=627af591fe55445c83abe50f753404c9, scope.project.id=91199bf0cd184c0eb867f99d5018bb1d, user.id=9736248d560340dba1575baeea8ca3ec) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:35.885907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d449b-aeb7-49e8-be8b-445e7c73657b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:35.888450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d449b-aeb7-49e8-be8b-445e7c73657b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:35.900183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 89/180] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:35 2022] GET /identity/v3/role_assignments?user.id=9736248d560340dba1575baeea8ca3ec&scope.project.id=91199bf0cd184c0eb867f99d5018bb1d&role.id=627af591fe55445c83abe50f753404c9 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:36.036828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0b0a-b369-4a78-8fed-2719499c8f7c None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.037558 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0b0a-b369-4a78-8fed-2719499c8f7c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.038058 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0b0a-b369-4a78-8fed-2719499c8f7c None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.040201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 92/181] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:36.046155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3687b-89cd-4298-bf61-fd79341548d5 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.046438 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3687b-89cd-4298-bf61-fd79341548d5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.046715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3687b-89cd-4298-bf61-fd79341548d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.064674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-24f3687b-89cd-4298-bf61-fd79341548d5 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:36.065859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-24f3687b-89cd-4298-bf61-fd79341548d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:36.079827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a5f91-5da9-4550-b39a-3b12f6996885 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.080460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a5f91-5da9-4550-b39a-3b12f6996885 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.080965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a5f91-5da9-4550-b39a-3b12f6996885 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.082593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 93/182] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:34:36.092431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093255c-7761-4d70-bbb4-3d6d1bc6b334 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.093037 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093255c-7761-4d70-bbb4-3d6d1bc6b334 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.093777 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093255c-7761-4d70-bbb4-3d6d1bc6b334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.116940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c093255c-7761-4d70-bbb4-3d6d1bc6b334 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:36.120553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c093255c-7761-4d70-bbb4-3d6d1bc6b334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:36.180052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 90/183] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:36.241841 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 94/184] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:36.250108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3687b-89cd-4298-bf61-fd79341548d5 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:36.273367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093255c-7761-4d70-bbb4-3d6d1bc6b334 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:36.373318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3687b-89cd-4298-bf61-fd79341548d5 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:36.392722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093255c-7761-4d70-bbb4-3d6d1bc6b334 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:36.410240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823ad45-c163-453a-a706-335b94ce2e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:36.411060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ad45-c163-453a-a706-335b94ce2e0e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.411340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ad45-c163-453a-a706-335b94ce2e0e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.411611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ad45-c163-453a-a706-335b94ce2e0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.425380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823ad45-c163-453a-a706-335b94ce2e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:36.430310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67454379-d923-4dc4-8a80-57235575c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:36.431161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67454379-d923-4dc4-8a80-57235575c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.431437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67454379-d923-4dc4-8a80-57235575c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.431725 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67454379-d923-4dc4-8a80-57235575c0f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-7823ad45-c163-453a-a706-335b94ce2e0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:36.435458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:36.436418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:36.437196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:36.438246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 91/185] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:34:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:36.439524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab673-3fd4-4a09-8ec9-8659d81dfac8 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.439864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab673-3fd4-4a09-8ec9-8659d81dfac8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.440149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab673-3fd4-4a09-8ec9-8659d81dfac8 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.444125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67454379-d923-4dc4-8a80-57235575c0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:36.445565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 92/186] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:36.446357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ab673-3fd4-4a09-8ec9-8659d81dfac8 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-67454379-d923-4dc4-8a80-57235575c0f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:36.452975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:36.453867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:36.454649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 95/187] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:34:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:34:36.455799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c656-773e-496a-8fdf-f7a3b3ad6aa9 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.455799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c656-773e-496a-8fdf-f7a3b3ad6aa9 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.456038 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c656-773e-496a-8fdf-f7a3b3ad6aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.472949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-0153c656-773e-496a-8fdf-f7a3b3ad6aa9 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:36.474142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0153c656-773e-496a-8fdf-f7a3b3ad6aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:36.563737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 96/188] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:36.563737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153c656-773e-496a-8fdf-f7a3b3ad6aa9 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:36.564026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ab673-3fd4-4a09-8ec9-8659d81dfac8 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:36.595349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c089ad-6785-4caf-8dea-de7dc2827865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:36.596054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c089ad-6785-4caf-8dea-de7dc2827865 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.596338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c089ad-6785-4caf-8dea-de7dc2827865 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.596617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c089ad-6785-4caf-8dea-de7dc2827865 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.597378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c089ad-6785-4caf-8dea-de7dc2827865 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:36.597902 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c089ad-6785-4caf-8dea-de7dc2827865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:36.599069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c089ad-6785-4caf-8dea-de7dc2827865 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:36.607724 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 93/189] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:34:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:36.608556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c089ad-6785-4caf-8dea-de7dc2827865 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:36.677795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153c656-773e-496a-8fdf-f7a3b3ad6aa9 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:36.706329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c089ad-6785-4caf-8dea-de7dc2827865 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:36.716175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfccf4-c797-4b19-9014-f612d5f935aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:36.716848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfccf4-c797-4b19-9014-f612d5f935aa None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.717131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfccf4-c797-4b19-9014-f612d5f935aa None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.717416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfccf4-c797-4b19-9014-f612d5f935aa None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.718160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfccf4-c797-4b19-9014-f612d5f935aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:36.718735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfccf4-c797-4b19-9014-f612d5f935aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:36.720138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfccf4-c797-4b19-9014-f612d5f935aa None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:36.727907 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 97/190] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:36.728687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfccf4-c797-4b19-9014-f612d5f935aa None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:36.745002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cba07c-5b52-4f82-b2fd-45b7dc8bef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:36.746498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cba07c-5b52-4f82-b2fd-45b7dc8bef29 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.746921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cba07c-5b52-4f82-b2fd-45b7dc8bef29 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.747348 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cba07c-5b52-4f82-b2fd-45b7dc8bef29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.748548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cba07c-5b52-4f82-b2fd-45b7dc8bef29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:36.750002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cba07c-5b52-4f82-b2fd-45b7dc8bef29 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:36.751599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 94/191] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:36.751599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cba07c-5b52-4f82-b2fd-45b7dc8bef29 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:36.830379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfccf4-c797-4b19-9014-f612d5f935aa None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:36.850257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cba07c-5b52-4f82-b2fd-45b7dc8bef29 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:36.863504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06934301-68d2-4247-b4c2-4d823c06bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:36.864417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06934301-68d2-4247-b4c2-4d823c06bab4 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.864698 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06934301-68d2-4247-b4c2-4d823c06bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.864972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06934301-68d2-4247-b4c2-4d823c06bab4 None admin] PATH_INFO: `/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.879355 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06934301-68d2-4247-b4c2-4d823c06bab4 None admin] RBAC: Authorizing `identity:get_user(user_id=bac0bbbdf2da4c09a8db3d006855a0ac)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:36.881224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06934301-68d2-4247-b4c2-4d823c06bab4 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:36.887750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc2666-9946-49bd-9702-cc8f72a5f982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:36.888158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 98/192] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:36 2022] GET /identity/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:36.888665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2666-9946-49bd-9702-cc8f72a5f982 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:36.888859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06934301-68d2-4247-b4c2-4d823c06bab4 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:36.888965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2666-9946-49bd-9702-cc8f72a5f982 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:36.889219 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2666-9946-49bd-9702-cc8f72a5f982 None admin] PATH_INFO: `/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:36.890407 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc2666-9946-49bd-9702-cc8f72a5f982 None admin] RBAC: Authorizing `identity:get_user(user_id=bac0bbbdf2da4c09a8db3d006855a0ac)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:36.891892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc2666-9946-49bd-9702-cc8f72a5f982 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:36.893625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 95/193] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:36 2022] GET /identity/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:36.896570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc2666-9946-49bd-9702-cc8f72a5f982 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:36.990409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06934301-68d2-4247-b4c2-4d823c06bab4 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:36.998789 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc2666-9946-49bd-9702-cc8f72a5f982 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:37.023899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb1f7e-3347-4243-97a3-26887cdb3ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:37.024578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1f7e-3347-4243-97a3-26887cdb3ead None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:37.024864 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1f7e-3347-4243-97a3-26887cdb3ead None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:37.025135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1f7e-3347-4243-97a3-26887cdb3ead None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:37.025873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb1f7e-3347-4243-97a3-26887cdb3ead None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:37.027450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb1f7e-3347-4243-97a3-26887cdb3ead None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:37.031416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbbefb-544d-47e4-af5a-8ee6b9da5c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:37.032105 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbefb-544d-47e4-af5a-8ee6b9da5c40 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:37.032390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbefb-544d-47e4-af5a-8ee6b9da5c40 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:37.032664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbefb-544d-47e4-af5a-8ee6b9da5c40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:37.047959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 99/194] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:34:36 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:37.048784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb1f7e-3347-4243-97a3-26887cdb3ead None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:37.129697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbbefb-544d-47e4-af5a-8ee6b9da5c40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:37.131694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbbefb-544d-47e4-af5a-8ee6b9da5c40 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:37.171396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb1f7e-3347-4243-97a3-26887cdb3ead None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:37.208229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2bc38-2d43-45da-95ed-218a87a85b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:37.208908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2bc38-2d43-45da-95ed-218a87a85b24 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:37.209191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2bc38-2d43-45da-95ed-218a87a85b24 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:37.209469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2bc38-2d43-45da-95ed-218a87a85b24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:37.240314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 96/195] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:37.245892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbbefb-544d-47e4-af5a-8ee6b9da5c40 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:37.292766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2bc38-2d43-45da-95ed-218a87a85b24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:37.295085 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2bc38-2d43-45da-95ed-218a87a85b24 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:37.359433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbbefb-544d-47e4-af5a-8ee6b9da5c40 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:37.399086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db0a3-c9cc-47de-882f-625a3df4c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:37.400421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db0a3-c9cc-47de-882f-625a3df4c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:37.400907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db0a3-c9cc-47de-882f-625a3df4c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:37.401405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db0a3-c9cc-47de-882f-625a3df4c6d4 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:37.403330 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576db0a3-c9cc-47de-882f-625a3df4c6d4 None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:37.405169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576db0a3-c9cc-47de-882f-625a3df4c6d4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:37.406983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 97/196] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:37 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:37.412747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db0a3-c9cc-47de-882f-625a3df4c6d4 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:37.417681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 100/197] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:37.423190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2bc38-2d43-45da-95ed-218a87a85b24 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:37.541781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2bc38-2d43-45da-95ed-218a87a85b24 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:37.542517 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db0a3-c9cc-47de-882f-625a3df4c6d4 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:37.596787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55091e-3862-446f-8368-427d7288fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:37.597659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55091e-3862-446f-8368-427d7288fde1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:37.597942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55091e-3862-446f-8368-427d7288fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:37.598217 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55091e-3862-446f-8368-427d7288fde1 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:37.599809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55091e-3862-446f-8368-427d7288fde1 None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:37.601246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55091e-3862-446f-8368-427d7288fde1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:37.604136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c631b-a4c7-4adc-926c-86c78eb61239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:37.604796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c631b-a4c7-4adc-926c-86c78eb61239 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:37.605080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c631b-a4c7-4adc-926c-86c78eb61239 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:37.605416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c631b-a4c7-4adc-926c-86c78eb61239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:37.606763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c631b-a4c7-4adc-926c-86c78eb61239 None admin] RBAC: Adding query filter params (role.id=004dfaca095a4141ae157de95aa6390a, scope.project.id=631886c48e954289908b5e89ccf44d8e, user.id=bac0bbbdf2da4c09a8db3d006855a0ac) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:37.607077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c631b-a4c7-4adc-926c-86c78eb61239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:37.608549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c631b-a4c7-4adc-926c-86c78eb61239 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:37.610885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 101/198] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:37 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:37.617869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55091e-3862-446f-8368-427d7288fde1 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:37.624545 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 98/199] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:37 2022] GET /identity/v3/role_assignments?user.id=bac0bbbdf2da4c09a8db3d006855a0ac&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=004dfaca095a4141ae157de95aa6390a => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:37.724881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55091e-3862-446f-8368-427d7288fde1 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:37.778471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879344ea-2350-4d0e-a1e1-bfe9903380ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:37.778924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879344ea-2350-4d0e-a1e1-bfe9903380ba None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:37.779205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879344ea-2350-4d0e-a1e1-bfe9903380ba None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:37.779475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879344ea-2350-4d0e-a1e1-bfe9903380ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:37.780417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879344ea-2350-4d0e-a1e1-bfe9903380ba None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=631886c48e954289908b5e89ccf44d8e, user.id=bac0bbbdf2da4c09a8db3d006855a0ac) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:37.780728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879344ea-2350-4d0e-a1e1-bfe9903380ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:37.782239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879344ea-2350-4d0e-a1e1-bfe9903380ba None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:37.790179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 102/200] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:37 2022] GET /identity/v3/role_assignments?user.id=bac0bbbdf2da4c09a8db3d006855a0ac&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=b104fd2e772843a0974990f965d8b589 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:38.087238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679ca3-af6f-4794-89c9-3507a8b8f90f None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:38.087621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679ca3-af6f-4794-89c9-3507a8b8f90f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:38.087887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c679ca3-af6f-4794-89c9-3507a8b8f90f None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:38.089317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 99/201] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:38.095408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340f84b-6b0b-41d0-81cf-3977798abe99 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:38.095701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340f84b-6b0b-41d0-81cf-3977798abe99 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:38.096009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340f84b-6b0b-41d0-81cf-3977798abe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:38.113132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-9340f84b-6b0b-41d0-81cf-3977798abe99 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:38.114325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9340f84b-6b0b-41d0-81cf-3977798abe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:38.181774 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 103/202] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:38.206582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c679ca3-af6f-4794-89c9-3507a8b8f90f None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:38.313400 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c679ca3-af6f-4794-89c9-3507a8b8f90f None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:38.355149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41ee64-9968-4922-8ddc-376607f365e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:38.356527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41ee64-9968-4922-8ddc-376607f365e8 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:38.359170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41ee64-9968-4922-8ddc-376607f365e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:38.359170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41ee64-9968-4922-8ddc-376607f365e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:38.376559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41ee64-9968-4922-8ddc-376607f365e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-7c41ee64-9968-4922-8ddc-376607f365e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:38.384388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:38.385243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:38.386080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 100/203] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:38.392804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340f84b-6b0b-41d0-81cf-3977798abe99 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:38.553015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340f84b-6b0b-41d0-81cf-3977798abe99 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:38.591079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fde16d-c16c-48d1-841d-60ac208f082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:38.591523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fde16d-c16c-48d1-841d-60ac208f082d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:38.591865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fde16d-c16c-48d1-841d-60ac208f082d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:38.592200 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fde16d-c16c-48d1-841d-60ac208f082d None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:38.592903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fde16d-c16c-48d1-841d-60ac208f082d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:38.593205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fde16d-c16c-48d1-841d-60ac208f082d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:38.594862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fde16d-c16c-48d1-841d-60ac208f082d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:38.603752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 104/204] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:38.616818 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41ee64-9968-4922-8ddc-376607f365e8 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:38.726229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41ee64-9968-4922-8ddc-376607f365e8 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:38.759608 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0481b-7667-474d-8f8f-e4adb76a4cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:38.760525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0481b-7667-474d-8f8f-e4adb76a4cfa None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:38.760809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0481b-7667-474d-8f8f-e4adb76a4cfa None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:38.761092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0481b-7667-474d-8f8f-e4adb76a4cfa None admin] PATH_INFO: `/v3/users/b4bf9d1158b94711a0b33eea299777dd` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:38.762969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0481b-7667-474d-8f8f-e4adb76a4cfa None admin] RBAC: Authorizing `identity:get_user(user_id=b4bf9d1158b94711a0b33eea299777dd)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:38.764453 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0481b-7667-474d-8f8f-e4adb76a4cfa None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:38.766085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 101/205] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:38 2022] GET /identity/v3/users/b4bf9d1158b94711a0b33eea299777dd => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:38.771765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fde16d-c16c-48d1-841d-60ac208f082d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:38.898459 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fde16d-c16c-48d1-841d-60ac208f082d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:38.942221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddfabf-1a33-4144-9b03-c9c57f9f0f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:38.942891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddfabf-1a33-4144-9b03-c9c57f9f0f2b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:38.943175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddfabf-1a33-4144-9b03-c9c57f9f0f2b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:38.943452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddfabf-1a33-4144-9b03-c9c57f9f0f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:39.034928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddfabf-1a33-4144-9b03-c9c57f9f0f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:39.036442 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddfabf-1a33-4144-9b03-c9c57f9f0f2b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:39.140524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 105/206] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:39.148834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0481b-7667-474d-8f8f-e4adb76a4cfa None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:39.327822 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0481b-7667-474d-8f8f-e4adb76a4cfa None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:39.381994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994f44c-5546-43a3-8ca8-625e84f6ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:39.383322 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994f44c-5546-43a3-8ca8-625e84f6ca7b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:39.383853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994f44c-5546-43a3-8ca8-625e84f6ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:39.384358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994f44c-5546-43a3-8ca8-625e84f6ca7b None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:39.388805 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994f44c-5546-43a3-8ca8-625e84f6ca7b None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:39.390673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994f44c-5546-43a3-8ca8-625e84f6ca7b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:39.392776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 102/207] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:39 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:39.403958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddfabf-1a33-4144-9b03-c9c57f9f0f2b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:39.531535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddfabf-1a33-4144-9b03-c9c57f9f0f2b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:39.568699 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5231d8-5975-4ad7-96e5-054b91e14eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:39.569395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5231d8-5975-4ad7-96e5-054b91e14eb5 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:39.569633 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5231d8-5975-4ad7-96e5-054b91e14eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:39.569917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5231d8-5975-4ad7-96e5-054b91e14eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:39.570769 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5231d8-5975-4ad7-96e5-054b91e14eb5 None admin] RBAC: Adding query filter params (role.id=0566c059f03f4e44b3a4bad9cdba3cdc, scope.project.id=3c0793f1f4e4422f921a1d20504a3726, user.id=b4bf9d1158b94711a0b33eea299777dd) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:39.571083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5231d8-5975-4ad7-96e5-054b91e14eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:39.572556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5231d8-5975-4ad7-96e5-054b91e14eb5 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:39.579610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 106/208] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:39 2022] GET /identity/v3/role_assignments?user.id=b4bf9d1158b94711a0b33eea299777dd&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=0566c059f03f4e44b3a4bad9cdba3cdc => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:39.992732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe23bf-c7d5-4caa-a5f8-00476b1df32c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:39.993709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe23bf-c7d5-4caa-a5f8-00476b1df32c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:39.994220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe23bf-c7d5-4caa-a5f8-00476b1df32c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:39.995836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 103/209] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:40.002794 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3856-ff23-4a37-8ac5-d4482fe000d3 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.003090 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3856-ff23-4a37-8ac5-d4482fe000d3 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.003375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3856-ff23-4a37-8ac5-d4482fe000d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.023823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a0fd3856-ff23-4a37-8ac5-d4482fe000d3 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:40.028927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a0fd3856-ff23-4a37-8ac5-d4482fe000d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:40.120212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 107/210] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:40.140870 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4123-c6a1-4be4-8404-64241acadf18 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.141181 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4123-c6a1-4be4-8404-64241acadf18 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.141419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4123-c6a1-4be4-8404-64241acadf18 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.142969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 104/211] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:40.146924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd3856-ff23-4a37-8ac5-d4482fe000d3 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:40.148874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d90de8-0059-464c-bb4b-23659b581de1 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.149156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d90de8-0059-464c-bb4b-23659b581de1 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.149434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d90de8-0059-464c-bb4b-23659b581de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.174513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-a8d90de8-0059-464c-bb4b-23659b581de1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:40.176111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a8d90de8-0059-464c-bb4b-23659b581de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:40.255886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 105/212] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:40.262975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd3856-ff23-4a37-8ac5-d4482fe000d3 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:40.273609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d90de8-0059-464c-bb4b-23659b581de1 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:40.299945 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de905f-923a-4afe-9766-cf74ca4e7484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:40.300750 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de905f-923a-4afe-9766-cf74ca4e7484 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.301038 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de905f-923a-4afe-9766-cf74ca4e7484 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.301375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de905f-923a-4afe-9766-cf74ca4e7484 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.312633 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de905f-923a-4afe-9766-cf74ca4e7484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-13de905f-923a-4afe-9766-cf74ca4e7484 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:40.320549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:40.321439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:40.322228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 108/213] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:40.329911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de905f-923a-4afe-9766-cf74ca4e7484 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:40.398870 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d90de8-0059-464c-bb4b-23659b581de1 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:40.439364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e789e-ef7b-4aa8-b39f-afe241e2f552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:40.440240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e789e-ef7b-4aa8-b39f-afe241e2f552 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.440534 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e789e-ef7b-4aa8-b39f-afe241e2f552 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.440816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e789e-ef7b-4aa8-b39f-afe241e2f552 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.442251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e789e-ef7b-4aa8-b39f-afe241e2f552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:40.443877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e789e-ef7b-4aa8-b39f-afe241e2f552 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:40.450889 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 106/214] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:40.453306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e789e-ef7b-4aa8-b39f-afe241e2f552 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:40.464765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de905f-923a-4afe-9766-cf74ca4e7484 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:40.510029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec6162-15df-4237-8eee-e02fe51553ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:40.510641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec6162-15df-4237-8eee-e02fe51553ff None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.510926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec6162-15df-4237-8eee-e02fe51553ff None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.511206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec6162-15df-4237-8eee-e02fe51553ff None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.512886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec6162-15df-4237-8eee-e02fe51553ff None admin] RBAC: Adding query filter params (name=member) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:40.513204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec6162-15df-4237-8eee-e02fe51553ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:40.515123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec6162-15df-4237-8eee-e02fe51553ff None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:40.527758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 109/215] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:40.533270 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec6162-15df-4237-8eee-e02fe51553ff None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:40.576915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e789e-ef7b-4aa8-b39f-afe241e2f552 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:40.617510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a867d-935e-4651-b29a-4ce731bea92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:40.618186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a867d-935e-4651-b29a-4ce731bea92c None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.618467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a867d-935e-4651-b29a-4ce731bea92c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.618740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a867d-935e-4651-b29a-4ce731bea92c None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.619450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a867d-935e-4651-b29a-4ce731bea92c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:40.620966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a867d-935e-4651-b29a-4ce731bea92c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:40.642573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 107/216] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:34:40 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:40.643923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886f79f-6136-4563-9b2e-87d2e958997c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.644216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886f79f-6136-4563-9b2e-87d2e958997c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.644499 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886f79f-6136-4563-9b2e-87d2e958997c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.650364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 108/217] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:40.650364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9fe58-6e0b-4e68-a5fe-f869876fe464 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.650364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9fe58-6e0b-4e68-a5fe-f869876fe464 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.650364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9fe58-6e0b-4e68-a5fe-f869876fe464 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.650364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 109/218] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:40.651518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0e2a-c9e2-40ce-b818-c0f61d12ac4f None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.651854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0e2a-c9e2-40ce-b818-c0f61d12ac4f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.652711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0e2a-c9e2-40ce-b818-c0f61d12ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.658123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec6162-15df-4237-8eee-e02fe51553ff None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:40.672220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-e13e0e2a-c9e2-40ce-b818-c0f61d12ac4f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:40.673355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e13e0e2a-c9e2-40ce-b818-c0f61d12ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:40.698094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a64a05-d214-49d1-8695-07b733fb9edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:40.699044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a64a05-d214-49d1-8695-07b733fb9edb None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.699342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a64a05-d214-49d1-8695-07b733fb9edb None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.700236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a64a05-d214-49d1-8695-07b733fb9edb None admin] PATH_INFO: `/v3/users/8ec30ae9a9d34798ad316120d34031a5` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.715522 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a64a05-d214-49d1-8695-07b733fb9edb None admin] RBAC: Authorizing `identity:get_user(user_id=8ec30ae9a9d34798ad316120d34031a5)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:40.717063 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a64a05-d214-49d1-8695-07b733fb9edb None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:40.719258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 110/219] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:40 2022] GET /identity/v3/users/8ec30ae9a9d34798ad316120d34031a5 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:40.727883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5a52-6538-40a3-9ad5-3e1579c2c33f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.727883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5a52-6538-40a3-9ad5-3e1579c2c33f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.727883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5a52-6538-40a3-9ad5-3e1579c2c33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.743848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2f8d5a52-6538-40a3-9ad5-3e1579c2c33f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:40.745079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2f8d5a52-6538-40a3-9ad5-3e1579c2c33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:40.751930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 110/220] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:40.751930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e0e2a-c9e2-40ce-b818-c0f61d12ac4f None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:40.815872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 111/221] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:40.816366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5a52-6538-40a3-9ad5-3e1579c2c33f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:40.849911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e0e2a-c9e2-40ce-b818-c0f61d12ac4f None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:40.887929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c96f5b-41e8-439b-b31d-25450fd1c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:40.888933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c96f5b-41e8-439b-b31d-25450fd1c932 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.889218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c96f5b-41e8-439b-b31d-25450fd1c932 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.889490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c96f5b-41e8-439b-b31d-25450fd1c932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.919799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5a52-6538-40a3-9ad5-3e1579c2c33f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:40.955070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64615c71-1bde-4d9e-ac5c-0def6064edfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:40.955902 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615c71-1bde-4d9e-ac5c-0def6064edfc None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:40.956183 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615c71-1bde-4d9e-ac5c-0def6064edfc None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:40.956457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615c71-1bde-4d9e-ac5c-0def6064edfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:40.963943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c96f5b-41e8-439b-b31d-25450fd1c932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:40.967010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c96f5b-41e8-439b-b31d-25450fd1c932 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:40.970365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64615c71-1bde-4d9e-ac5c-0def6064edfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-64615c71-1bde-4d9e-ac5c-0def6064edfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:40.978133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:40.979301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:40.980325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:40.981279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 112/222] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:34:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:40.982215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64615c71-1bde-4d9e-ac5c-0def6064edfc None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:41.071030 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 111/223] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:41.072573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c96f5b-41e8-439b-b31d-25450fd1c932 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:41.085021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64615c71-1bde-4d9e-ac5c-0def6064edfc None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:41.120172 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a17019-fec7-40ec-a795-516871dfb855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:41.121597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17019-fec7-40ec-a795-516871dfb855 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:41.121908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17019-fec7-40ec-a795-516871dfb855 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:41.122153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17019-fec7-40ec-a795-516871dfb855 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:41.132936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a17019-fec7-40ec-a795-516871dfb855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-09a17019-fec7-40ec-a795-516871dfb855 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:41.142151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:41.143283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 113/224] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:34:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:41.144280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a17019-fec7-40ec-a795-516871dfb855 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:41.179974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c96f5b-41e8-439b-b31d-25450fd1c932 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:41.216328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52654558-1a15-4fde-a96a-3bd8e48d850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:41.217320 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654558-1a15-4fde-a96a-3bd8e48d850b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:41.217747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654558-1a15-4fde-a96a-3bd8e48d850b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:41.218182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654558-1a15-4fde-a96a-3bd8e48d850b None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:41.219338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52654558-1a15-4fde-a96a-3bd8e48d850b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:41.219812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52654558-1a15-4fde-a96a-3bd8e48d850b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:41.221387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52654558-1a15-4fde-a96a-3bd8e48d850b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:41.230041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 112/225] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:41.231668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52654558-1a15-4fde-a96a-3bd8e48d850b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:41.247814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a17019-fec7-40ec-a795-516871dfb855 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:41.282560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53847977-b006-407f-aa76-c7dc2aa87359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:41.283870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53847977-b006-407f-aa76-c7dc2aa87359 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:41.284236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53847977-b006-407f-aa76-c7dc2aa87359 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:41.284589 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53847977-b006-407f-aa76-c7dc2aa87359 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:41.285898 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53847977-b006-407f-aa76-c7dc2aa87359 None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:41.288487 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53847977-b006-407f-aa76-c7dc2aa87359 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:41.293509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 114/226] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:41 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:41.294231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53847977-b006-407f-aa76-c7dc2aa87359 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:41.348308 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52654558-1a15-4fde-a96a-3bd8e48d850b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:41.393373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec5d6e-550d-4529-a0bc-6866b52bf79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:41.394336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec5d6e-550d-4529-a0bc-6866b52bf79a None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:41.394336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec5d6e-550d-4529-a0bc-6866b52bf79a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:41.394631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec5d6e-550d-4529-a0bc-6866b52bf79a None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:41.395351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec5d6e-550d-4529-a0bc-6866b52bf79a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:41.395658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec5d6e-550d-4529-a0bc-6866b52bf79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:41.397310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec5d6e-550d-4529-a0bc-6866b52bf79a None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:41.411158 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 113/227] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:34:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:41.412109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec5d6e-550d-4529-a0bc-6866b52bf79a None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:41.422602 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53847977-b006-407f-aa76-c7dc2aa87359 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:41.465263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf4fa8-a67a-49ea-81f3-30f295c52b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:41.466743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf4fa8-a67a-49ea-81f3-30f295c52b96 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:41.467358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf4fa8-a67a-49ea-81f3-30f295c52b96 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:41.467960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf4fa8-a67a-49ea-81f3-30f295c52b96 None admin] PATH_INFO: `/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:41.470014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf4fa8-a67a-49ea-81f3-30f295c52b96 None admin] RBAC: Authorizing `identity:get_user(user_id=bac0bbbdf2da4c09a8db3d006855a0ac)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:41.471441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf4fa8-a67a-49ea-81f3-30f295c52b96 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:41.473448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 115/228] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:41 2022] GET /identity/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:41.474318 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf4fa8-a67a-49ea-81f3-30f295c52b96 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:41.524094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec5d6e-550d-4529-a0bc-6866b52bf79a None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:41.558692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6b8db-9212-4a21-acc9-c31277e4abe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:41.560291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b8db-9212-4a21-acc9-c31277e4abe5 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:41.560819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b8db-9212-4a21-acc9-c31277e4abe5 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:41.561286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b8db-9212-4a21-acc9-c31277e4abe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:41.562354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6b8db-9212-4a21-acc9-c31277e4abe5 None admin] RBAC: Adding query filter params (role.id=627af591fe55445c83abe50f753404c9, scope.project.id=631886c48e954289908b5e89ccf44d8e, user.id=8ec30ae9a9d34798ad316120d34031a5) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:41.562878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6b8db-9212-4a21-acc9-c31277e4abe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:41.564560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6b8db-9212-4a21-acc9-c31277e4abe5 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:41.571333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 114/229] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:41 2022] GET /identity/v3/role_assignments?user.id=8ec30ae9a9d34798ad316120d34031a5&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=627af591fe55445c83abe50f753404c9 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:41.572466 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6b8db-9212-4a21-acc9-c31277e4abe5 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:41.618326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf4fa8-a67a-49ea-81f3-30f295c52b96 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:41.693917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84bd5b-7cb5-497d-9e3b-2ee2e40b77b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:41.694807 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84bd5b-7cb5-497d-9e3b-2ee2e40b77b0 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:41.695094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84bd5b-7cb5-497d-9e3b-2ee2e40b77b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:41.695370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84bd5b-7cb5-497d-9e3b-2ee2e40b77b0 None admin] PATH_INFO: `/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:41.700747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84bd5b-7cb5-497d-9e3b-2ee2e40b77b0 None admin] RBAC: Authorizing `identity:get_user(user_id=bac0bbbdf2da4c09a8db3d006855a0ac)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:41.702259 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84bd5b-7cb5-497d-9e3b-2ee2e40b77b0 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:41.704390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 116/230] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:41 2022] GET /identity/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:41.711246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84bd5b-7cb5-497d-9e3b-2ee2e40b77b0 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:41.733324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6b8db-9212-4a21-acc9-c31277e4abe5 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:41.797436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac065d-a4d8-4ddf-b7b2-20211c11bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:41.798696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac065d-a4d8-4ddf-b7b2-20211c11bf9e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:41.799213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac065d-a4d8-4ddf-b7b2-20211c11bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:41.799679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac065d-a4d8-4ddf-b7b2-20211c11bf9e None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:41.802986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac065d-a4d8-4ddf-b7b2-20211c11bf9e None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:41.805578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac065d-a4d8-4ddf-b7b2-20211c11bf9e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:41.811075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 115/231] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:41 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:41.820687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac065d-a4d8-4ddf-b7b2-20211c11bf9e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:41.912923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84bd5b-7cb5-497d-9e3b-2ee2e40b77b0 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:41.986960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8015aa-8289-4ec6-9b5d-916c746ebefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:41.987882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8015aa-8289-4ec6-9b5d-916c746ebefc None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:41.988165 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8015aa-8289-4ec6-9b5d-916c746ebefc None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:41.988435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8015aa-8289-4ec6-9b5d-916c746ebefc None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:41.990695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8015aa-8289-4ec6-9b5d-916c746ebefc None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:41.992208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8015aa-8289-4ec6-9b5d-916c746ebefc None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:41.994210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 117/232] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:41 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:42.001046 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8015aa-8289-4ec6-9b5d-916c746ebefc None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:42.019431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac065d-a4d8-4ddf-b7b2-20211c11bf9e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:42.076491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5892f-c498-4d04-8981-050bffd36c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:42.077150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5892f-c498-4d04-8981-050bffd36c72 None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:42.077390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5892f-c498-4d04-8981-050bffd36c72 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:42.077628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5892f-c498-4d04-8981-050bffd36c72 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e/users/bac0bbbdf2da4c09a8db3d006855a0ac/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:42.079596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5892f-c498-4d04-8981-050bffd36c72 None admin] RBAC: Authorizing `identity:create_grant(project_id=631886c48e954289908b5e89ccf44d8e, user_id=bac0bbbdf2da4c09a8db3d006855a0ac, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:42.081098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5892f-c498-4d04-8981-050bffd36c72 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:42.096909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 116/233] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:34:41 2022] PUT /identity/v3/projects/631886c48e954289908b5e89ccf44d8e/users/bac0bbbdf2da4c09a8db3d006855a0ac/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:34:42.201319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8015aa-8289-4ec6-9b5d-916c746ebefc None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:42.252412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635f0d7-62c0-4cde-a4c2-fccc312b3e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:42.253691 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f0d7-62c0-4cde-a4c2-fccc312b3e00 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:42.254189 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f0d7-62c0-4cde-a4c2-fccc312b3e00 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:42.254659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f0d7-62c0-4cde-a4c2-fccc312b3e00 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e/users/bac0bbbdf2da4c09a8db3d006855a0ac/roles/004dfaca095a4141ae157de95aa6390a` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:42.261688 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635f0d7-62c0-4cde-a4c2-fccc312b3e00 None admin] RBAC: Authorizing `identity:create_grant(project_id=631886c48e954289908b5e89ccf44d8e, user_id=bac0bbbdf2da4c09a8db3d006855a0ac, role_id=004dfaca095a4141ae157de95aa6390a)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:42.263142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635f0d7-62c0-4cde-a4c2-fccc312b3e00 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:42.294825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 118/234] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:34:42 2022] PUT /identity/v3/projects/631886c48e954289908b5e89ccf44d8e/users/bac0bbbdf2da4c09a8db3d006855a0ac/roles/004dfaca095a4141ae157de95aa6390a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:34:43.316786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8f447-1a5c-47a6-9011-7d3a7a2adf26 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:43.317282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8f447-1a5c-47a6-9011-7d3a7a2adf26 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:43.317282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8f447-1a5c-47a6-9011-7d3a7a2adf26 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:43.318946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 117/235] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:43.324829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25c98-7707-4997-8ba5-8add7f6b5627 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:43.325252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25c98-7707-4997-8ba5-8add7f6b5627 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:43.325418 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25c98-7707-4997-8ba5-8add7f6b5627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:43.345765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-22c25c98-7707-4997-8ba5-8add7f6b5627 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:43.346952 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-22c25c98-7707-4997-8ba5-8add7f6b5627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:43.351611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a0bf-3fbe-4f62-93bc-f7c90e82c4e7 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:43.351941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a0bf-3fbe-4f62-93bc-f7c90e82c4e7 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:43.352222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a0bf-3fbe-4f62-93bc-f7c90e82c4e7 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:43.353588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 118/236] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:43.359381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49967957-8e2d-4311-b2c2-54f9b604757d None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:43.359673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49967957-8e2d-4311-b2c2-54f9b604757d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:43.359990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49967957-8e2d-4311-b2c2-54f9b604757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:43.378143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-49967957-8e2d-4311-b2c2-54f9b604757d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:43.380634 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-49967957-8e2d-4311-b2c2-54f9b604757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:43.468771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 119/237] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:43.482091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 119/238] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:43.497125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c25c98-7707-4997-8ba5-8add7f6b5627 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:43.513823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49967957-8e2d-4311-b2c2-54f9b604757d None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:43.621667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c25c98-7707-4997-8ba5-8add7f6b5627 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:43.665777 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2db7b-58a4-45c5-b2a8-77da36cbd60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:43.666973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2db7b-58a4-45c5-b2a8-77da36cbd60e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:43.667454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2db7b-58a4-45c5-b2a8-77da36cbd60e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:43.668346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2db7b-58a4-45c5-b2a8-77da36cbd60e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:43.676518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2db7b-58a4-45c5-b2a8-77da36cbd60e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:43.678006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2db7b-58a4-45c5-b2a8-77da36cbd60e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:43.680093 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 120/239] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:43.688070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2db7b-58a4-45c5-b2a8-77da36cbd60e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:43.707292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49967957-8e2d-4311-b2c2-54f9b604757d None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:43.749036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d171300-3c01-4031-9147-607c5e075df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:43.750207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d171300-3c01-4031-9147-607c5e075df7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:43.750707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d171300-3c01-4031-9147-607c5e075df7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:43.751174 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d171300-3c01-4031-9147-607c5e075df7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:43.762949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d171300-3c01-4031-9147-607c5e075df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-8d171300-3c01-4031-9147-607c5e075df7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:43.772190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:43.773067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:43.773831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:43.777923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 120/240] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:34:43.788708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d171300-3c01-4031-9147-607c5e075df7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:43.845144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2db7b-58a4-45c5-b2a8-77da36cbd60e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:43.909558 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be06bf-ad88-483f-bd39-7698bd9d4791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:43.910161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be06bf-ad88-483f-bd39-7698bd9d4791 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:43.910442 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be06bf-ad88-483f-bd39-7698bd9d4791 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:43.910719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be06bf-ad88-483f-bd39-7698bd9d4791 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:43.911454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be06bf-ad88-483f-bd39-7698bd9d4791 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:43.912947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be06bf-ad88-483f-bd39-7698bd9d4791 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:43.955285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 121/241] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:34:43 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:34:43.977506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d171300-3c01-4031-9147-607c5e075df7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:44.029331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66654cc-333f-4c39-a3ec-fa41f6105551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:44.030052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66654cc-333f-4c39-a3ec-fa41f6105551 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:44.030342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66654cc-333f-4c39-a3ec-fa41f6105551 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:44.030624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66654cc-333f-4c39-a3ec-fa41f6105551 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:44.031436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66654cc-333f-4c39-a3ec-fa41f6105551 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:44.031772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66654cc-333f-4c39-a3ec-fa41f6105551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:44.033272 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66654cc-333f-4c39-a3ec-fa41f6105551 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:44.048476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 121/242] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:44.054210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be06bf-ad88-483f-bd39-7698bd9d4791 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:44.192182 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be06bf-ad88-483f-bd39-7698bd9d4791 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:44.217776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b39a-7e03-42f9-910f-e44498d6eb4f None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:44.218084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b39a-7e03-42f9-910f-e44498d6eb4f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:44.218593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b39a-7e03-42f9-910f-e44498d6eb4f None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:44.220152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 122/243] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:34:44.225329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5f7ce-0778-4063-890b-faa3eb59e82e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:44.225618 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5f7ce-0778-4063-890b-faa3eb59e82e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:44.225897 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5f7ce-0778-4063-890b-faa3eb59e82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:44.243461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855b2ea-b117-422d-825d-8b9ebe9fdfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:44.244314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-ddc5f7ce-0778-4063-890b-faa3eb59e82e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:44.244983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855b2ea-b117-422d-825d-8b9ebe9fdfb4 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:44.245475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855b2ea-b117-422d-825d-8b9ebe9fdfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:44.245579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ddc5f7ce-0778-4063-890b-faa3eb59e82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:44.246071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855b2ea-b117-422d-825d-8b9ebe9fdfb4 None admin] PATH_INFO: `/v3/users/24c4a0501b374f639bd9d4d69155b05d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:44.263493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855b2ea-b117-422d-825d-8b9ebe9fdfb4 None admin] RBAC: Authorizing `identity:get_user(user_id=24c4a0501b374f639bd9d4d69155b05d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:44.265780 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855b2ea-b117-422d-825d-8b9ebe9fdfb4 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:44.272197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 122/244] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:44 2022] GET /identity/v3/users/24c4a0501b374f639bd9d4d69155b05d => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:44.274685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855b2ea-b117-422d-825d-8b9ebe9fdfb4 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:44.333875 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 123/245] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:44.357828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5f7ce-0778-4063-890b-faa3eb59e82e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:44.393390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855b2ea-b117-422d-825d-8b9ebe9fdfb4 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:44.429855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45923b-15d2-4895-8e83-4bda598d8086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:44.430516 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45923b-15d2-4895-8e83-4bda598d8086 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:44.430798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45923b-15d2-4895-8e83-4bda598d8086 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:44.431072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45923b-15d2-4895-8e83-4bda598d8086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:44.463543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5f7ce-0778-4063-890b-faa3eb59e82e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:44.500038 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1a969-7def-4f1e-9c18-6ebf7115d796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:44.500854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1a969-7def-4f1e-9c18-6ebf7115d796 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:44.501137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1a969-7def-4f1e-9c18-6ebf7115d796 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:44.501410 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1a969-7def-4f1e-9c18-6ebf7115d796 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:44.502831 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45923b-15d2-4895-8e83-4bda598d8086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:44.504537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45923b-15d2-4895-8e83-4bda598d8086 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:44.514620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1a969-7def-4f1e-9c18-6ebf7115d796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-00e1a969-7def-4f1e-9c18-6ebf7115d796 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:44.523537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:44.524555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:44.526916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 124/246] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:34:44.534085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1a969-7def-4f1e-9c18-6ebf7115d796 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:44.621904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 123/247] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:44.628308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45923b-15d2-4895-8e83-4bda598d8086 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:44.656964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1a969-7def-4f1e-9c18-6ebf7115d796 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:44.694160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b77ec-81cd-4d02-9568-8d7921428c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:44.694838 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b77ec-81cd-4d02-9568-8d7921428c51 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:44.695124 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b77ec-81cd-4d02-9568-8d7921428c51 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:44.695405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b77ec-81cd-4d02-9568-8d7921428c51 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:44.696230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b77ec-81cd-4d02-9568-8d7921428c51 None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:44.696541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b77ec-81cd-4d02-9568-8d7921428c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:44.698338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b77ec-81cd-4d02-9568-8d7921428c51 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:44.707422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 125/248] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:44.712923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b77ec-81cd-4d02-9568-8d7921428c51 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:44.735126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45923b-15d2-4895-8e83-4bda598d8086 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:44.772345 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741d746-50b5-4f85-84d1-dd30b758caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:44.773449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741d746-50b5-4f85-84d1-dd30b758caa2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:44.773873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741d746-50b5-4f85-84d1-dd30b758caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:44.774289 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741d746-50b5-4f85-84d1-dd30b758caa2 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:44.775640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741d746-50b5-4f85-84d1-dd30b758caa2 None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:44.777547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741d746-50b5-4f85-84d1-dd30b758caa2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:44.783810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 124/249] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:44 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:44.785748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741d746-50b5-4f85-84d1-dd30b758caa2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:44.815304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b77ec-81cd-4d02-9568-8d7921428c51 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:44.852484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2af82-7136-4567-823a-646384818aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:44.853372 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2af82-7136-4567-823a-646384818aab None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:44.853651 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2af82-7136-4567-823a-646384818aab None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:44.853927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2af82-7136-4567-823a-646384818aab None admin] PATH_INFO: `/v3/users/8ec30ae9a9d34798ad316120d34031a5` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:44.855854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2af82-7136-4567-823a-646384818aab None admin] RBAC: Authorizing `identity:get_user(user_id=8ec30ae9a9d34798ad316120d34031a5)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:44.857372 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2af82-7136-4567-823a-646384818aab None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:44.859447 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 126/250] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:44 2022] GET /identity/v3/users/8ec30ae9a9d34798ad316120d34031a5 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:44.865245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2af82-7136-4567-823a-646384818aab None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:44.900453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741d746-50b5-4f85-84d1-dd30b758caa2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:44.944895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282f744-c9c0-40c1-8bed-7c70910f262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:44.945827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282f744-c9c0-40c1-8bed-7c70910f262d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:44.946416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282f744-c9c0-40c1-8bed-7c70910f262d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:44.946838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282f744-c9c0-40c1-8bed-7c70910f262d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:44.949809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282f744-c9c0-40c1-8bed-7c70910f262d None admin] RBAC: Adding query filter params (role.id=0566c059f03f4e44b3a4bad9cdba3cdc, scope.project.id=631886c48e954289908b5e89ccf44d8e, user.id=24c4a0501b374f639bd9d4d69155b05d) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:44.950123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282f744-c9c0-40c1-8bed-7c70910f262d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:44.951650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282f744-c9c0-40c1-8bed-7c70910f262d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:44.959849 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 125/251] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:44 2022] GET /identity/v3/role_assignments?user.id=24c4a0501b374f639bd9d4d69155b05d&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=0566c059f03f4e44b3a4bad9cdba3cdc => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:44.993699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2af82-7136-4567-823a-646384818aab None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:45.034552 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3d679-bf3f-4800-a7c6-d078e30f880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:45.035901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3d679-bf3f-4800-a7c6-d078e30f880f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:45.036389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3d679-bf3f-4800-a7c6-d078e30f880f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:45.036867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3d679-bf3f-4800-a7c6-d078e30f880f None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:45.038338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3d679-bf3f-4800-a7c6-d078e30f880f None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:45.040056 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3d679-bf3f-4800-a7c6-d078e30f880f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:45.042540 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 127/252] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:44 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:45.048634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282f744-c9c0-40c1-8bed-7c70910f262d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:45.179607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282f744-c9c0-40c1-8bed-7c70910f262d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:45.216650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc6df6-a799-410f-a2db-ba36a7639ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:45.217557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc6df6-a799-410f-a2db-ba36a7639ae2 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:45.217842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc6df6-a799-410f-a2db-ba36a7639ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:45.218117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc6df6-a799-410f-a2db-ba36a7639ae2 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e/users/8ec30ae9a9d34798ad316120d34031a5/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:45.220475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc6df6-a799-410f-a2db-ba36a7639ae2 None admin] RBAC: Authorizing `identity:create_grant(project_id=631886c48e954289908b5e89ccf44d8e, user_id=8ec30ae9a9d34798ad316120d34031a5, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:45.222343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc6df6-a799-410f-a2db-ba36a7639ae2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:45.223702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833a0e2-d6de-4aff-8517-e1fab24e953e None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:45.224011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833a0e2-d6de-4aff-8517-e1fab24e953e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:45.224289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833a0e2-d6de-4aff-8517-e1fab24e953e None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:45.225654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 128/253] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:34:45.231845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99160-4fcf-4f74-baa6-5ac98ff20646 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:45.232126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99160-4fcf-4f74-baa6-5ac98ff20646 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:45.232404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99160-4fcf-4f74-baa6-5ac98ff20646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:45.247443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 126/254] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:34:45 2022] PUT /identity/v3/projects/631886c48e954289908b5e89ccf44d8e/users/8ec30ae9a9d34798ad316120d34031a5/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:34:45.250101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-8cf99160-4fcf-4f74-baa6-5ac98ff20646 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:45.251351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-8cf99160-4fcf-4f74-baa6-5ac98ff20646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:45.327422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 129/255] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:45.364380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb93c5c-c691-4665-be5e-415e24030787 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:45.364707 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb93c5c-c691-4665-be5e-415e24030787 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:45.364977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb93c5c-c691-4665-be5e-415e24030787 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:45.366370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 127/256] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:45.382096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb93c5c-c691-4665-be5e-415e24030787 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:45.382751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921a27-4b6a-4253-af00-fad34cab4cec None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:45.383192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921a27-4b6a-4253-af00-fad34cab4cec None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:45.383349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a921a27-4b6a-4253-af00-fad34cab4cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:45.412859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0a921a27-4b6a-4253-af00-fad34cab4cec None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:45.414101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0a921a27-4b6a-4253-af00-fad34cab4cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:45.514963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb93c5c-c691-4665-be5e-415e24030787 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:45.550508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91f550-e085-4507-a991-847942b144c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:45.551344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f550-e085-4507-a991-847942b144c8 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:45.551624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f550-e085-4507-a991-847942b144c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:45.551961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f550-e085-4507-a991-847942b144c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:45.563468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91f550-e085-4507-a991-847942b144c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:45.566352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 130/257] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-bb91f550-e085-4507-a991-847942b144c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:45.578198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:45.579148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:34:45.579944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:45.580537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 128/258] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:34:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:45.587481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a921a27-4b6a-4253-af00-fad34cab4cec None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:45.608939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91f550-e085-4507-a991-847942b144c8 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:45.721866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91f550-e085-4507-a991-847942b144c8 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:45.764089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5063ea7-c3cc-4d60-a603-10f4e782857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:45.764613 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a921a27-4b6a-4253-af00-fad34cab4cec None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:45.764912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063ea7-c3cc-4d60-a603-10f4e782857e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:45.765248 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063ea7-c3cc-4d60-a603-10f4e782857e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:45.765471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5063ea7-c3cc-4d60-a603-10f4e782857e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:45.776995 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5063ea7-c3cc-4d60-a603-10f4e782857e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-e5063ea7-c3cc-4d60-a603-10f4e782857e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:45.786179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:45.787081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:45.787908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:45.794509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 129/259] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:34:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:45.795422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5063ea7-c3cc-4d60-a603-10f4e782857e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:45.802710 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3c21b-5fdf-4c30-af8f-2b947af9942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:45.803574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3c21b-5fdf-4c30-af8f-2b947af9942c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:45.803899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3c21b-5fdf-4c30-af8f-2b947af9942c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:45.804183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3c21b-5fdf-4c30-af8f-2b947af9942c None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:45.805498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3c21b-5fdf-4c30-af8f-2b947af9942c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:45.805819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3c21b-5fdf-4c30-af8f-2b947af9942c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:45.807589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3c21b-5fdf-4c30-af8f-2b947af9942c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:45.819419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 131/260] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:45.825447 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3c21b-5fdf-4c30-af8f-2b947af9942c None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:45.939124 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3c21b-5fdf-4c30-af8f-2b947af9942c None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:45.978559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812562cf-6918-4948-ab43-875dd2af910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:45.979604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812562cf-6918-4948-ab43-875dd2af910d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:45.979947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812562cf-6918-4948-ab43-875dd2af910d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:45.980352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812562cf-6918-4948-ab43-875dd2af910d None admin] PATH_INFO: `/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:45.981644 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812562cf-6918-4948-ab43-875dd2af910d None admin] RBAC: Authorizing `identity:get_user(user_id=bac0bbbdf2da4c09a8db3d006855a0ac)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:45.983160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812562cf-6918-4948-ab43-875dd2af910d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:45.985541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 132/261] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:45 2022] GET /identity/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:45.990949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812562cf-6918-4948-ab43-875dd2af910d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:46.016497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5063ea7-c3cc-4d60-a603-10f4e782857e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:46.104376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812562cf-6918-4948-ab43-875dd2af910d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:46.112416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d261-d634-4ba1-b1ed-f338fecd84b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:46.113099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d261-d634-4ba1-b1ed-f338fecd84b7 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:46.113381 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d261-d634-4ba1-b1ed-f338fecd84b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:46.113656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d261-d634-4ba1-b1ed-f338fecd84b7 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:46.114423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d261-d634-4ba1-b1ed-f338fecd84b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:46.114729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d261-d634-4ba1-b1ed-f338fecd84b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:46.116211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d261-d634-4ba1-b1ed-f338fecd84b7 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:46.130953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 130/262] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:34:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:46.136250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d261-d634-4ba1-b1ed-f338fecd84b7 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:46.141909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f16e6-121a-40ab-bb26-5749d6a7aa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:46.142570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f16e6-121a-40ab-bb26-5749d6a7aa48 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:46.142854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f16e6-121a-40ab-bb26-5749d6a7aa48 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:46.143131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f16e6-121a-40ab-bb26-5749d6a7aa48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:46.275351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f16e6-121a-40ab-bb26-5749d6a7aa48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:46.276762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f16e6-121a-40ab-bb26-5749d6a7aa48 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:46.279844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d261-d634-4ba1-b1ed-f338fecd84b7 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:46.325706 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406445-1545-4146-ad2f-057b37e90a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:46.326582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406445-1545-4146-ad2f-057b37e90a0e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:46.326854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406445-1545-4146-ad2f-057b37e90a0e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:46.327120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406445-1545-4146-ad2f-057b37e90a0e None admin] PATH_INFO: `/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:46.328936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19406445-1545-4146-ad2f-057b37e90a0e None admin] RBAC: Authorizing `identity:get_user(user_id=bac0bbbdf2da4c09a8db3d006855a0ac)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:46.330369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19406445-1545-4146-ad2f-057b37e90a0e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:46.336983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 131/263] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:46 2022] GET /identity/v3/users/bac0bbbdf2da4c09a8db3d006855a0ac => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:46.340376 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406445-1545-4146-ad2f-057b37e90a0e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:46.452572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 133/264] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:46.458322 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f16e6-121a-40ab-bb26-5749d6a7aa48 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:46.470224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406445-1545-4146-ad2f-057b37e90a0e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:46.508824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fcc82-6d1b-4994-9ba3-d5606e3a76a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:46.509481 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fcc82-6d1b-4994-9ba3-d5606e3a76a4 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:46.509768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fcc82-6d1b-4994-9ba3-d5606e3a76a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:46.510037 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fcc82-6d1b-4994-9ba3-d5606e3a76a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:46.579089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fcc82-6d1b-4994-9ba3-d5606e3a76a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:46.580569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fcc82-6d1b-4994-9ba3-d5606e3a76a4 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:46.594952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f16e6-121a-40ab-bb26-5749d6a7aa48 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:46.672971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4f283-bae2-4611-856b-5d00f9425072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:46.673858 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4f283-bae2-4611-856b-5d00f9425072 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:46.674142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4f283-bae2-4611-856b-5d00f9425072 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:46.674421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4f283-bae2-4611-856b-5d00f9425072 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:46.680434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4f283-bae2-4611-856b-5d00f9425072 None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:46.681924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4f283-bae2-4611-856b-5d00f9425072 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:46.683814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 132/265] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:34:46.684419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 134/266] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:46 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:46.686129 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fcc82-6d1b-4994-9ba3-d5606e3a76a4 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:46.690420 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4f283-bae2-4611-856b-5d00f9425072 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:46.786848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fcc82-6d1b-4994-9ba3-d5606e3a76a4 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:46.822005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f18fe6-f50d-42df-a955-c9dc9ddfb20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:46.822868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f18fe6-f50d-42df-a955-c9dc9ddfb20f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:46.823146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f18fe6-f50d-42df-a955-c9dc9ddfb20f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:46.823415 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f18fe6-f50d-42df-a955-c9dc9ddfb20f None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:46.824890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f18fe6-f50d-42df-a955-c9dc9ddfb20f None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:46.826332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f18fe6-f50d-42df-a955-c9dc9ddfb20f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:46.831904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 133/267] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:46 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:46.834110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f18fe6-f50d-42df-a955-c9dc9ddfb20f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:46.922601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4f283-bae2-4611-856b-5d00f9425072 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:46.951599 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f18fe6-f50d-42df-a955-c9dc9ddfb20f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:46.986283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d127f-168a-46ce-be9e-cd387b89bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:46.986939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d127f-168a-46ce-be9e-cd387b89bd91 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:46.987695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d127f-168a-46ce-be9e-cd387b89bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:46.988202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d127f-168a-46ce-be9e-cd387b89bd91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:46.989412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d127f-168a-46ce-be9e-cd387b89bd91 None admin] RBAC: Adding query filter params (role.id=004dfaca095a4141ae157de95aa6390a, scope.project.id=631886c48e954289908b5e89ccf44d8e, user.id=bac0bbbdf2da4c09a8db3d006855a0ac) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:46.989989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d127f-168a-46ce-be9e-cd387b89bd91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:46.991810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d127f-168a-46ce-be9e-cd387b89bd91 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:47.004056 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 134/268] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:46 2022] GET /identity/v3/role_assignments?user.id=bac0bbbdf2da4c09a8db3d006855a0ac&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=004dfaca095a4141ae157de95aa6390a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:47.017786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4e126-2b28-4bbf-b1b8-cded8499bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:47.018476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4e126-2b28-4bbf-b1b8-cded8499bd26 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:47.018758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4e126-2b28-4bbf-b1b8-cded8499bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:47.019034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4e126-2b28-4bbf-b1b8-cded8499bd26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:47.019923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4e126-2b28-4bbf-b1b8-cded8499bd26 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=631886c48e954289908b5e89ccf44d8e, user.id=bac0bbbdf2da4c09a8db3d006855a0ac) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:47.020239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4e126-2b28-4bbf-b1b8-cded8499bd26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:47.021764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4e126-2b28-4bbf-b1b8-cded8499bd26 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:47.037276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 135/269] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:46 2022] GET /identity/v3/role_assignments?user.id=bac0bbbdf2da4c09a8db3d006855a0ac&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=b104fd2e772843a0974990f965d8b589 => generated 608 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:47.696076 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79df56-736d-49f6-b33c-238153490789 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:47.696826 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79df56-736d-49f6-b33c-238153490789 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:47.696826 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79df56-736d-49f6-b33c-238153490789 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:47.698350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 135/270] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:47.704158 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422d9d-f95e-46ac-bc98-3935cbeada6a None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:47.705090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422d9d-f95e-46ac-bc98-3935cbeada6a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:47.705573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422d9d-f95e-46ac-bc98-3935cbeada6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:47.726645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-3b422d9d-f95e-46ac-bc98-3935cbeada6a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:47.728243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3b422d9d-f95e-46ac-bc98-3935cbeada6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:47.822594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 136/271] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:47.859340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79df56-736d-49f6-b33c-238153490789 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:47.996965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79df56-736d-49f6-b33c-238153490789 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:48.032451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852ace6-ac83-4798-98f0-664ed9dce2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:48.033669 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ace6-ac83-4798-98f0-664ed9dce2fe None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.034148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ace6-ac83-4798-98f0-664ed9dce2fe None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.034619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ace6-ac83-4798-98f0-664ed9dce2fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.046141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852ace6-ac83-4798-98f0-664ed9dce2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-5852ace6-ac83-4798-98f0-664ed9dce2fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:48.054223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:48.055113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:48.055924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:48.058443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 136/272] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:48.064694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b422d9d-f95e-46ac-bc98-3935cbeada6a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:48.176010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b422d9d-f95e-46ac-bc98-3935cbeada6a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:48.212086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb432607-076b-4cbe-85d2-10492708367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:48.213154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb432607-076b-4cbe-85d2-10492708367a None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.213637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb432607-076b-4cbe-85d2-10492708367a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.214151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb432607-076b-4cbe-85d2-10492708367a None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.215169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb432607-076b-4cbe-85d2-10492708367a None admin] RBAC: Adding query filter params (name=reader) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:48.215747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb432607-076b-4cbe-85d2-10492708367a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:48.217504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb432607-076b-4cbe-85d2-10492708367a None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:48.227218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 137/273] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:48.232636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852ace6-ac83-4798-98f0-664ed9dce2fe None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:48.334126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587a41-3f88-484f-9e8f-44cd1bb45a44 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.334328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587a41-3f88-484f-9e8f-44cd1bb45a44 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.334582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587a41-3f88-484f-9e8f-44cd1bb45a44 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.336245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 138/274] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:34:48.343912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852ace6-ac83-4798-98f0-664ed9dce2fe None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:48.344978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3fe02-35ca-486e-bf6a-16f82f92d117 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.345307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3fe02-35ca-486e-bf6a-16f82f92d117 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.345567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3fe02-35ca-486e-bf6a-16f82f92d117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.362417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-50d3fe02-35ca-486e-bf6a-16f82f92d117 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:48.363603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-50d3fe02-35ca-486e-bf6a-16f82f92d117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:48.378833 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888b2fd-4f7c-43f8-9b41-7161f1e7949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:48.379729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888b2fd-4f7c-43f8-9b41-7161f1e7949f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.380031 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888b2fd-4f7c-43f8-9b41-7161f1e7949f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.380308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888b2fd-4f7c-43f8-9b41-7161f1e7949f None admin] PATH_INFO: `/v3/users/24c4a0501b374f639bd9d4d69155b05d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.381599 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888b2fd-4f7c-43f8-9b41-7161f1e7949f None admin] RBAC: Authorizing `identity:get_user(user_id=24c4a0501b374f639bd9d4d69155b05d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:48.383110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888b2fd-4f7c-43f8-9b41-7161f1e7949f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:48.385190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 137/275] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:48 2022] GET /identity/v3/users/24c4a0501b374f639bd9d4d69155b05d => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:48.386676 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e81815-0d6b-48cf-8c00-ddf9b11a66e2 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.386973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e81815-0d6b-48cf-8c00-ddf9b11a66e2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.387299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e81815-0d6b-48cf-8c00-ddf9b11a66e2 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.388736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 138/276] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:48.392725 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e81815-0d6b-48cf-8c00-ddf9b11a66e2 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:48.439300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 139/277] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:48.440977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416d1b-d4e3-4e5d-ba58-5fc7db927b86 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.441337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416d1b-d4e3-4e5d-ba58-5fc7db927b86 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.441690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416d1b-d4e3-4e5d-ba58-5fc7db927b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.467333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f4416d1b-d4e3-4e5d-ba58-5fc7db927b86 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:48.469759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f4416d1b-d4e3-4e5d-ba58-5fc7db927b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:48.516021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e81815-0d6b-48cf-8c00-ddf9b11a66e2 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:48.537582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 140/278] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:48.538552 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4416d1b-d4e3-4e5d-ba58-5fc7db927b86 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:48.562256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ca635-30e8-4044-a135-be047b99004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:48.563675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ca635-30e8-4044-a135-be047b99004b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.564299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ca635-30e8-4044-a135-be047b99004b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.564577 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ca635-30e8-4044-a135-be047b99004b None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.565762 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ca635-30e8-4044-a135-be047b99004b None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:48.567194 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ca635-30e8-4044-a135-be047b99004b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:48.569304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 139/279] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:48 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:48.570334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ca635-30e8-4044-a135-be047b99004b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:48.635555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4416d1b-d4e3-4e5d-ba58-5fc7db927b86 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:48.663452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ca635-30e8-4044-a135-be047b99004b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:48.668769 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e55f-8838-457f-8cd0-25cf3dc6779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:48.669562 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e55f-8838-457f-8cd0-25cf3dc6779d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.669851 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e55f-8838-457f-8cd0-25cf3dc6779d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.670132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21e55f-8838-457f-8cd0-25cf3dc6779d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.671300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21e55f-8838-457f-8cd0-25cf3dc6779d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:48.672774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21e55f-8838-457f-8cd0-25cf3dc6779d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:48.674378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 141/280] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:48.679036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e55f-8838-457f-8cd0-25cf3dc6779d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:48.696328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eddbc-5abe-4212-8edd-88ad1552ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:48.697118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eddbc-5abe-4212-8edd-88ad1552ad2f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.697393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eddbc-5abe-4212-8edd-88ad1552ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.697664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eddbc-5abe-4212-8edd-88ad1552ad2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.707310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eddbc-5abe-4212-8edd-88ad1552ad2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-f43eddbc-5abe-4212-8edd-88ad1552ad2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:48.715527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:48.716440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:48.717212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 140/281] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:48.718118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca3cf7-d514-4a8c-a1e9-20233ba8a0a8 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.718504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca3cf7-d514-4a8c-a1e9-20233ba8a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.718765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca3cf7-d514-4a8c-a1e9-20233ba8a0a8 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.720043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 141/282] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:48.722069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca3cf7-d514-4a8c-a1e9-20233ba8a0a8 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:48.773976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21e55f-8838-457f-8cd0-25cf3dc6779d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:48.805243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db845430-a8eb-44b1-8250-b0866ce96252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:48.806125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db845430-a8eb-44b1-8250-b0866ce96252 None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.806408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db845430-a8eb-44b1-8250-b0866ce96252 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.806685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db845430-a8eb-44b1-8250-b0866ce96252 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e/users/24c4a0501b374f639bd9d4d69155b05d/roles/0566c059f03f4e44b3a4bad9cdba3cdc` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.809359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db845430-a8eb-44b1-8250-b0866ce96252 None admin] RBAC: Authorizing `identity:create_grant(project_id=631886c48e954289908b5e89ccf44d8e, user_id=24c4a0501b374f639bd9d4d69155b05d, role_id=0566c059f03f4e44b3a4bad9cdba3cdc)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:48.810801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db845430-a8eb-44b1-8250-b0866ce96252 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:48.817720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca3cf7-d514-4a8c-a1e9-20233ba8a0a8 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:48.824563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 142/283] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:34:48 2022] PUT /identity/v3/projects/631886c48e954289908b5e89ccf44d8e/users/24c4a0501b374f639bd9d4d69155b05d/roles/0566c059f03f4e44b3a4bad9cdba3cdc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:34:48.825295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db845430-a8eb-44b1-8250-b0866ce96252 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:48.852668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4aa41-499c-4638-a676-c4f7ec55c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:48.853358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4aa41-499c-4638-a676-c4f7ec55c9a2 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.853632 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4aa41-499c-4638-a676-c4f7ec55c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.853906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4aa41-499c-4638-a676-c4f7ec55c9a2 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.854648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4aa41-499c-4638-a676-c4f7ec55c9a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:48.856590 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4aa41-499c-4638-a676-c4f7ec55c9a2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:48.887834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 142/284] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:34:48 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:48.887834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02632b3f-82e9-47ed-bceb-01d635dab1ca None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:48.887834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02632b3f-82e9-47ed-bceb-01d635dab1ca None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:48.887834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02632b3f-82e9-47ed-bceb-01d635dab1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:48.898427 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-02632b3f-82e9-47ed-bceb-01d635dab1ca None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:48.899631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-02632b3f-82e9-47ed-bceb-01d635dab1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:48.978908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 143/285] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:48.992181 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db845430-a8eb-44b1-8250-b0866ce96252 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:49.005033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02632b3f-82e9-47ed-bceb-01d635dab1ca None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:49.037716 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806153c6-0e01-448d-ab24-989ccfb20456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:49.038760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806153c6-0e01-448d-ab24-989ccfb20456 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:49.039189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806153c6-0e01-448d-ab24-989ccfb20456 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:49.039748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806153c6-0e01-448d-ab24-989ccfb20456 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:49.040665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806153c6-0e01-448d-ab24-989ccfb20456 None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:49.041120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806153c6-0e01-448d-ab24-989ccfb20456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:49.043264 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806153c6-0e01-448d-ab24-989ccfb20456 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:49.052778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 143/286] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:49.061077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806153c6-0e01-448d-ab24-989ccfb20456 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:49.143794 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02632b3f-82e9-47ed-bceb-01d635dab1ca None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:49.177480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806153c6-0e01-448d-ab24-989ccfb20456 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:49.190336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe28aea-2597-4c98-8d10-c1ae3cddf5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:49.191780 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe28aea-2597-4c98-8d10-c1ae3cddf5e0 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:49.194939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe28aea-2597-4c98-8d10-c1ae3cddf5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:49.194939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe28aea-2597-4c98-8d10-c1ae3cddf5e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:49.210095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe28aea-2597-4c98-8d10-c1ae3cddf5e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:49.216024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48287282-5621-477e-95f0-b5afa833db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:49.217087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287282-5621-477e-95f0-b5afa833db69 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:49.217374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287282-5621-477e-95f0-b5afa833db69 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:49.217652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287282-5621-477e-95f0-b5afa833db69 None admin] PATH_INFO: `/v3/users/aa35c39e2e7a416c9e06318701bb1665` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-efe28aea-2597-4c98-8d10-c1ae3cddf5e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:49.220613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:49.221502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:49.222294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 144/287] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:34:49.227410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe28aea-2597-4c98-8d10-c1ae3cddf5e0 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:49.239278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48287282-5621-477e-95f0-b5afa833db69 None admin] RBAC: Authorizing `identity:get_user(user_id=aa35c39e2e7a416c9e06318701bb1665)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:49.240739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48287282-5621-477e-95f0-b5afa833db69 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:49.242291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 144/288] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:49 2022] GET /identity/v3/users/aa35c39e2e7a416c9e06318701bb1665 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:49.249162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48287282-5621-477e-95f0-b5afa833db69 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:49.373877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe28aea-2597-4c98-8d10-c1ae3cddf5e0 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:49.376846 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48287282-5621-477e-95f0-b5afa833db69 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:49.413718 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ea35e-94e0-4b09-a921-3631c539044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:49.414298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ea35e-94e0-4b09-a921-3631c539044b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:49.414580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ea35e-94e0-4b09-a921-3631c539044b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:49.414856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ea35e-94e0-4b09-a921-3631c539044b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:49.415699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ea35e-94e0-4b09-a921-3631c539044b None admin] RBAC: Adding query filter params (role.id=627af591fe55445c83abe50f753404c9, user.id=aa35c39e2e7a416c9e06318701bb1665, scope.system=all) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:49.416043 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ea35e-94e0-4b09-a921-3631c539044b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:49.417560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ea35e-94e0-4b09-a921-3631c539044b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:49.423152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 145/289] 10.222.0.72 () {56 vars in 1308 bytes} [Mon May 16 18:34:49 2022] GET /identity/v3/role_assignments?user.id=aa35c39e2e7a416c9e06318701bb1665&scope.system=all&role.id=627af591fe55445c83abe50f753404c9 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:49.424755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d81ea0-a167-4bf3-8c29-ef2333a28520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:49.425449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d81ea0-a167-4bf3-8c29-ef2333a28520 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:49.425732 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d81ea0-a167-4bf3-8c29-ef2333a28520 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:49.426009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d81ea0-a167-4bf3-8c29-ef2333a28520 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:49.426788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d81ea0-a167-4bf3-8c29-ef2333a28520 None admin] RBAC: Adding query filter params (name=member) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:49.427095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d81ea0-a167-4bf3-8c29-ef2333a28520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:49.428549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d81ea0-a167-4bf3-8c29-ef2333a28520 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:49.444026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 145/290] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:49.450166 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ea35e-94e0-4b09-a921-3631c539044b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:49.597068 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ea35e-94e0-4b09-a921-3631c539044b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:49.635335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204d3ac-cf64-44b2-a35c-3d8be5f10046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:49.636856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d3ac-cf64-44b2-a35c-3d8be5f10046 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:49.637146 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d3ac-cf64-44b2-a35c-3d8be5f10046 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:49.637418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d3ac-cf64-44b2-a35c-3d8be5f10046 None admin] PATH_INFO: `/v3/users/8ec30ae9a9d34798ad316120d34031a5` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:49.638707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204d3ac-cf64-44b2-a35c-3d8be5f10046 None admin] RBAC: Authorizing `identity:get_user(user_id=8ec30ae9a9d34798ad316120d34031a5)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:49.640228 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204d3ac-cf64-44b2-a35c-3d8be5f10046 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:49.642219 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 146/291] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:49 2022] GET /identity/v3/users/8ec30ae9a9d34798ad316120d34031a5 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:49.647810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d81ea0-a167-4bf3-8c29-ef2333a28520 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:49.762443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d81ea0-a167-4bf3-8c29-ef2333a28520 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:49.796226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542feba3-aaa7-4570-9b88-a064b871fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:49.796885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542feba3-aaa7-4570-9b88-a064b871fde1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:49.797162 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542feba3-aaa7-4570-9b88-a064b871fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:49.797431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542feba3-aaa7-4570-9b88-a064b871fde1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:49.865358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542feba3-aaa7-4570-9b88-a064b871fde1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:49.866860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542feba3-aaa7-4570-9b88-a064b871fde1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:49.966017 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 146/292] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:49.971694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204d3ac-cf64-44b2-a35c-3d8be5f10046 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:50.072894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204d3ac-cf64-44b2-a35c-3d8be5f10046 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:50.107468 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e34fe7-087a-4808-9bd0-9407a8f5cb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:50.108417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e34fe7-087a-4808-9bd0-9407a8f5cb86 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:50.108723 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e34fe7-087a-4808-9bd0-9407a8f5cb86 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:50.108968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e34fe7-087a-4808-9bd0-9407a8f5cb86 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:50.110145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e34fe7-087a-4808-9bd0-9407a8f5cb86 None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:50.111575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e34fe7-087a-4808-9bd0-9407a8f5cb86 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:50.113580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 147/293] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:49 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:50.119231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542feba3-aaa7-4570-9b88-a064b871fde1 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:50.217449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542feba3-aaa7-4570-9b88-a064b871fde1 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:50.251116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf88cf-ae7e-4c64-af2a-3d038d09c09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:50.251793 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf88cf-ae7e-4c64-af2a-3d038d09c09a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:50.252077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf88cf-ae7e-4c64-af2a-3d038d09c09a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:50.252348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf88cf-ae7e-4c64-af2a-3d038d09c09a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:50.253186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf88cf-ae7e-4c64-af2a-3d038d09c09a None admin] RBAC: Adding query filter params (role.id=627af591fe55445c83abe50f753404c9, scope.project.id=631886c48e954289908b5e89ccf44d8e, user.id=8ec30ae9a9d34798ad316120d34031a5) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:50.253553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf88cf-ae7e-4c64-af2a-3d038d09c09a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:50.255034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf88cf-ae7e-4c64-af2a-3d038d09c09a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:50.261282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 147/294] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:50 2022] GET /identity/v3/role_assignments?user.id=8ec30ae9a9d34798ad316120d34031a5&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=627af591fe55445c83abe50f753404c9 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:51.525863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a7d8-ef1d-4949-abc2-76db80bc1246 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:51.526392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a7d8-ef1d-4949-abc2-76db80bc1246 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:51.526498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a7d8-ef1d-4949-abc2-76db80bc1246 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:51.528452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 148/295] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:51.533843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bbccc-aca2-48cd-97cf-990c685b0190 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:51.534644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bbccc-aca2-48cd-97cf-990c685b0190 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:51.535119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bbccc-aca2-48cd-97cf-990c685b0190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:51.552930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-580bbccc-aca2-48cd-97cf-990c685b0190 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:51.554414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-580bbccc-aca2-48cd-97cf-990c685b0190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:51.627809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 148/296] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:51.632128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9af13-842d-48cf-8d1e-3d8a3aac495b None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:51.632644 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9af13-842d-48cf-8d1e-3d8a3aac495b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:51.633141 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9af13-842d-48cf-8d1e-3d8a3aac495b None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:51.634958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 149/297] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:51.641214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131a92c-b5a9-4101-b5da-b52855577da2 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:51.641782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131a92c-b5a9-4101-b5da-b52855577da2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:51.642257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131a92c-b5a9-4101-b5da-b52855577da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:51.648834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9af13-842d-48cf-8d1e-3d8a3aac495b None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:51.660151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-4131a92c-b5a9-4101-b5da-b52855577da2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:51.661341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4131a92c-b5a9-4101-b5da-b52855577da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:51.748622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 149/298] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:51.748622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363756f-8783-4fda-97e8-65b3eafb5678 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:51.748622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363756f-8783-4fda-97e8-65b3eafb5678 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:51.748622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363756f-8783-4fda-97e8-65b3eafb5678 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:51.748622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 150/299] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:51.754475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a1ec-c1da-48cd-b42a-b980112179bb None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:51.754763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a1ec-c1da-48cd-b42a-b980112179bb None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:51.755041 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a1ec-c1da-48cd-b42a-b980112179bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:51.757794 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9af13-842d-48cf-8d1e-3d8a3aac495b None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:51.774412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-0ad6a1ec-c1da-48cd-b42a-b980112179bb None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:51.775607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0ad6a1ec-c1da-48cd-b42a-b980112179bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:51.793173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231bdcf-7e16-49cd-a0d9-f4fa80a68396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:51.793852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bdcf-7e16-49cd-a0d9-f4fa80a68396 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:51.794134 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bdcf-7e16-49cd-a0d9-f4fa80a68396 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:51.794416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bdcf-7e16-49cd-a0d9-f4fa80a68396 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:51.804418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231bdcf-7e16-49cd-a0d9-f4fa80a68396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-1231bdcf-7e16-49cd-a0d9-f4fa80a68396 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:51.812270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:51.813157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 150/300] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:51.818722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231bdcf-7e16-49cd-a0d9-f4fa80a68396 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:51.847637 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 151/301] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:51.848850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a1ec-c1da-48cd-b42a-b980112179bb None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:51.929483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231bdcf-7e16-49cd-a0d9-f4fa80a68396 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:51.958670 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a1ec-c1da-48cd-b42a-b980112179bb None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:51.966932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a44d78-4fd2-4c03-99b0-c0e44adcd4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:51.967748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a44d78-4fd2-4c03-99b0-c0e44adcd4cc None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:51.968042 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a44d78-4fd2-4c03-99b0-c0e44adcd4cc None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:51.968591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a44d78-4fd2-4c03-99b0-c0e44adcd4cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:51.969770 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a44d78-4fd2-4c03-99b0-c0e44adcd4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:51.971203 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a44d78-4fd2-4c03-99b0-c0e44adcd4cc None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:51.972841 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 151/302] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:51.973596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a44d78-4fd2-4c03-99b0-c0e44adcd4cc None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:51.997059 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb4557-c88b-47b7-a6e6-656772f64535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:51.997743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4557-c88b-47b7-a6e6-656772f64535 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:51.998021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4557-c88b-47b7-a6e6-656772f64535 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:51.998299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4557-c88b-47b7-a6e6-656772f64535 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:51.999054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb4557-c88b-47b7-a6e6-656772f64535 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:51.999358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb4557-c88b-47b7-a6e6-656772f64535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:52.000768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb4557-c88b-47b7-a6e6-656772f64535 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:52.013593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 152/303] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:52.013593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb4557-c88b-47b7-a6e6-656772f64535 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:52.084238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a44d78-4fd2-4c03-99b0-c0e44adcd4cc None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:52.118357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4b000-d477-4669-a630-1334ef611155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:52.119159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4b000-d477-4669-a630-1334ef611155 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.119303 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb4557-c88b-47b7-a6e6-656772f64535 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:52.119477 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4b000-d477-4669-a630-1334ef611155 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.119742 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4b000-d477-4669-a630-1334ef611155 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.130404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4b000-d477-4669-a630-1334ef611155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-f4c4b000-d477-4669-a630-1334ef611155 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:52.138937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:52.139885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:52.140673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 152/304] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:52.141313 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4b000-d477-4669-a630-1334ef611155 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:52.156931 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcb369-0d9e-4d34-83db-f994b464d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:52.157641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb369-0d9e-4d34-83db-f994b464d139 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.157930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb369-0d9e-4d34-83db-f994b464d139 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.158193 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb369-0d9e-4d34-83db-f994b464d139 None admin] PATH_INFO: `/v3/groups` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.158886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcb369-0d9e-4d34-83db-f994b464d139 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:52.160345 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcb369-0d9e-4d34-83db-f994b464d139 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:52.175362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 153/305] 10.222.0.72 () {60 vars in 1134 bytes} [Mon May 16 18:34:52 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:52.184040 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcb369-0d9e-4d34-83db-f994b464d139 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:52.274236 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4b000-d477-4669-a630-1334ef611155 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:52.290372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcb369-0d9e-4d34-83db-f994b464d139 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:52.312297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99413634-b062-440b-80a1-adebf08c68eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:52.313294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99413634-b062-440b-80a1-adebf08c68eb None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.313645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99413634-b062-440b-80a1-adebf08c68eb None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.313996 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99413634-b062-440b-80a1-adebf08c68eb None admin] PATH_INFO: `/v3/users/24c4a0501b374f639bd9d4d69155b05d` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.315346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99413634-b062-440b-80a1-adebf08c68eb None admin] RBAC: Authorizing `identity:get_user(user_id=24c4a0501b374f639bd9d4d69155b05d)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:52.316883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99413634-b062-440b-80a1-adebf08c68eb None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:52.318574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 153/306] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:52 2022] GET /identity/v3/users/24c4a0501b374f639bd9d4d69155b05d => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:52.319888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372bf9-b50b-4a1c-ab26-c4a87b90d4da None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.320171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372bf9-b50b-4a1c-ab26-c4a87b90d4da None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.320443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372bf9-b50b-4a1c-ab26-c4a87b90d4da None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.326865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 154/307] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:52.327678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372bf9-b50b-4a1c-ab26-c4a87b90d4da None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:52.335289 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0fcd5-90b3-48ef-97e7-de11eb6b4a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:52.335929 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0fcd5-90b3-48ef-97e7-de11eb6b4a27 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.336209 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0fcd5-90b3-48ef-97e7-de11eb6b4a27 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.336485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0fcd5-90b3-48ef-97e7-de11eb6b4a27 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.337254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0fcd5-90b3-48ef-97e7-de11eb6b4a27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:52.337557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0fcd5-90b3-48ef-97e7-de11eb6b4a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:52.338939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0fcd5-90b3-48ef-97e7-de11eb6b4a27 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:52.348956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 154/308] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:52.350462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e5871-e2f4-4e37-89f1-72c9b475cc35 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.350818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e5871-e2f4-4e37-89f1-72c9b475cc35 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.351163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e5871-e2f4-4e37-89f1-72c9b475cc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.368107 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-051e5871-e2f4-4e37-89f1-72c9b475cc35 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:52.369306 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-051e5871-e2f4-4e37-89f1-72c9b475cc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:52.442004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 155/309] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:52.442842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e5871-e2f4-4e37-89f1-72c9b475cc35 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:52.454957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372bf9-b50b-4a1c-ab26-c4a87b90d4da None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:52.492897 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085e775-88cf-4dd8-a052-a2302f9084d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:52.493823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085e775-88cf-4dd8-a052-a2302f9084d8 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.494106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085e775-88cf-4dd8-a052-a2302f9084d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.494383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085e775-88cf-4dd8-a052-a2302f9084d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.556799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e5871-e2f4-4e37-89f1-72c9b475cc35 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:52.565811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085e775-88cf-4dd8-a052-a2302f9084d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:52.567289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085e775-88cf-4dd8-a052-a2302f9084d8 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:52.591993 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f75d0-aafe-42e1-9690-19fd5942d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:52.593171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f75d0-aafe-42e1-9690-19fd5942d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.593718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f75d0-aafe-42e1-9690-19fd5942d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.593991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f75d0-aafe-42e1-9690-19fd5942d6e6 None admin] PATH_INFO: `/v3/users/4b4fc3a937a94272ba759fc92449c17d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.608555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f75d0-aafe-42e1-9690-19fd5942d6e6 None admin] RBAC: Authorizing `identity:get_user(user_id=4b4fc3a937a94272ba759fc92449c17d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:52.610041 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f75d0-aafe-42e1-9690-19fd5942d6e6 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:52.611785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 156/310] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:52 2022] GET /identity/v3/users/4b4fc3a937a94272ba759fc92449c17d => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:52.616816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f75d0-aafe-42e1-9690-19fd5942d6e6 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:52.665033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 155/311] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:52.665883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085e775-88cf-4dd8-a052-a2302f9084d8 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:52.715332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f75d0-aafe-42e1-9690-19fd5942d6e6 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:52.751414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94894-46b8-4332-8ed7-c793527f223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:52.752244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94894-46b8-4332-8ed7-c793527f223d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.752531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94894-46b8-4332-8ed7-c793527f223d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.752808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94894-46b8-4332-8ed7-c793527f223d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.763514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b94894-46b8-4332-8ed7-c793527f223d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:52.767071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085e775-88cf-4dd8-a052-a2302f9084d8 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-84b94894-46b8-4332-8ed7-c793527f223d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:52.771241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:52.772157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:52.772970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 157/312] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:52.773636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94894-46b8-4332-8ed7-c793527f223d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:52.805471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a5769-419a-4758-96ff-2d5c4a01b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:52.806131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a5769-419a-4758-96ff-2d5c4a01b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.806412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a5769-419a-4758-96ff-2d5c4a01b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.806720 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a5769-419a-4758-96ff-2d5c4a01b8d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.807534 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a5769-419a-4758-96ff-2d5c4a01b8d4 None admin] RBAC: Adding query filter params (role.id=0566c059f03f4e44b3a4bad9cdba3cdc, user.id=4b4fc3a937a94272ba759fc92449c17d, scope.system=all) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:52.807876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a5769-419a-4758-96ff-2d5c4a01b8d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:52.809917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a5769-419a-4758-96ff-2d5c4a01b8d4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:52.819977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 156/313] 10.222.0.72 () {56 vars in 1308 bytes} [Mon May 16 18:34:52 2022] GET /identity/v3/role_assignments?user.id=4b4fc3a937a94272ba759fc92449c17d&scope.system=all&role.id=0566c059f03f4e44b3a4bad9cdba3cdc => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:52.819977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a5769-419a-4758-96ff-2d5c4a01b8d4 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:52.879113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94894-46b8-4332-8ed7-c793527f223d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:52.914856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ea76-24e0-436f-85ea-0d97a8e0373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:52.915762 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ea76-24e0-436f-85ea-0d97a8e0373a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.916046 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ea76-24e0-436f-85ea-0d97a8e0373a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.916319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ea76-24e0-436f-85ea-0d97a8e0373a None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.918089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44ea76-24e0-436f-85ea-0d97a8e0373a None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:52.919561 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44ea76-24e0-436f-85ea-0d97a8e0373a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:52.921729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 158/314] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:52 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:52.927431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ea76-24e0-436f-85ea-0d97a8e0373a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:52.940119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a5769-419a-4758-96ff-2d5c4a01b8d4 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:52.977754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70884b-7bcf-4b86-bb49-3fbbb886ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:52.978456 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70884b-7bcf-4b86-bb49-3fbbb886ff5e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:52.978742 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70884b-7bcf-4b86-bb49-3fbbb886ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:52.979025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70884b-7bcf-4b86-bb49-3fbbb886ff5e None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:52.980423 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70884b-7bcf-4b86-bb49-3fbbb886ff5e None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:52.981384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70884b-7bcf-4b86-bb49-3fbbb886ff5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:52.982818 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70884b-7bcf-4b86-bb49-3fbbb886ff5e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:52.992247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 157/315] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:52.998847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70884b-7bcf-4b86-bb49-3fbbb886ff5e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:53.039347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ea76-24e0-436f-85ea-0d97a8e0373a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:53.078725 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d10d32-5b90-4aac-82b8-8138cf4b7c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:53.079400 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d10d32-5b90-4aac-82b8-8138cf4b7c9b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:53.079883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d10d32-5b90-4aac-82b8-8138cf4b7c9b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:53.080164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d10d32-5b90-4aac-82b8-8138cf4b7c9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:53.081826 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d10d32-5b90-4aac-82b8-8138cf4b7c9b None admin] RBAC: Adding query filter params (role.id=0566c059f03f4e44b3a4bad9cdba3cdc, scope.project.id=631886c48e954289908b5e89ccf44d8e, user.id=24c4a0501b374f639bd9d4d69155b05d) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:53.082150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d10d32-5b90-4aac-82b8-8138cf4b7c9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:53.083732 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d10d32-5b90-4aac-82b8-8138cf4b7c9b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:53.098563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 159/316] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:34:52 2022] GET /identity/v3/role_assignments?user.id=24c4a0501b374f639bd9d4d69155b05d&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=0566c059f03f4e44b3a4bad9cdba3cdc => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:34:53.119145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70884b-7bcf-4b86-bb49-3fbbb886ff5e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:53.156230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca96a44-cfe4-4e16-93aa-0539f92d1256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:53.157033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca96a44-cfe4-4e16-93aa-0539f92d1256 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:53.157314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca96a44-cfe4-4e16-93aa-0539f92d1256 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:53.157588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca96a44-cfe4-4e16-93aa-0539f92d1256 None admin] PATH_INFO: `/v3/users/aa35c39e2e7a416c9e06318701bb1665` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:53.158806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca96a44-cfe4-4e16-93aa-0539f92d1256 None admin] RBAC: Authorizing `identity:get_user(user_id=aa35c39e2e7a416c9e06318701bb1665)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:53.160373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca96a44-cfe4-4e16-93aa-0539f92d1256 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:53.162377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 158/317] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:52 2022] GET /identity/v3/users/aa35c39e2e7a416c9e06318701bb1665 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:53.169272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d10d32-5b90-4aac-82b8-8138cf4b7c9b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:53.286228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d10d32-5b90-4aac-82b8-8138cf4b7c9b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:53.322523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245092f2-8bec-44ff-843d-2ce500496db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:53.323404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245092f2-8bec-44ff-843d-2ce500496db8 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:53.323872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245092f2-8bec-44ff-843d-2ce500496db8 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:53.324703 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245092f2-8bec-44ff-843d-2ce500496db8 None admin] PATH_INFO: `/v3/system/users/aa35c39e2e7a416c9e06318701bb1665/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:53.326280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245092f2-8bec-44ff-843d-2ce500496db8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aa35c39e2e7a416c9e06318701bb1665, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:53.327664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245092f2-8bec-44ff-843d-2ce500496db8 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:53.341225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 160/318] 10.222.0.72 () {58 vars in 1334 bytes} [Mon May 16 18:34:53 2022] PUT /identity/v3/system/users/aa35c39e2e7a416c9e06318701bb1665/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:34:54.491234 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2de2b8-b516-44ad-9b4d-9445efff9a58 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:54.491821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2de2b8-b516-44ad-9b4d-9445efff9a58 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:54.491821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2de2b8-b516-44ad-9b4d-9445efff9a58 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:54.493205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 159/319] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:54.499181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511c55-fbd4-41f4-8c19-c512d5a8d2bd None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:54.499608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511c55-fbd4-41f4-8c19-c512d5a8d2bd None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:54.499798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511c55-fbd4-41f4-8c19-c512d5a8d2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:54.516451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-e0511c55-fbd4-41f4-8c19-c512d5a8d2bd None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:54.517633 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e0511c55-fbd4-41f4-8c19-c512d5a8d2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:54.588681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 161/320] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:54.612916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2de2b8-b516-44ad-9b4d-9445efff9a58 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:54.714688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2de2b8-b516-44ad-9b4d-9445efff9a58 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:54.749462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760ab23-ed87-4936-9bb9-a55347f24cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:54.750183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ab23-ed87-4936-9bb9-a55347f24cbe None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:54.750465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ab23-ed87-4936-9bb9-a55347f24cbe None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:54.750738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ab23-ed87-4936-9bb9-a55347f24cbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:54.751929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760ab23-ed87-4936-9bb9-a55347f24cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:54.753391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760ab23-ed87-4936-9bb9-a55347f24cbe None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:54.755206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 160/321] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:34:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:54.760663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0511c55-fbd4-41f4-8c19-c512d5a8d2bd None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:54.856996 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0511c55-fbd4-41f4-8c19-c512d5a8d2bd None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:54.889647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b052de-f1c5-4526-968e-1a53f927efbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:54.890313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b052de-f1c5-4526-968e-1a53f927efbd None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:54.890596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b052de-f1c5-4526-968e-1a53f927efbd None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:54.890874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b052de-f1c5-4526-968e-1a53f927efbd None admin] PATH_INFO: `/v3/groups` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:54.891572 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b052de-f1c5-4526-968e-1a53f927efbd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:54.893047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b052de-f1c5-4526-968e-1a53f927efbd None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:54.908352 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 162/322] 10.222.0.72 () {60 vars in 1134 bytes} [Mon May 16 18:34:54 2022] POST /identity/v3/groups => generated 226 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:34:55.132735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf86c9-99ab-4d2b-b9d3-16cfee134093 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:55.133126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf86c9-99ab-4d2b-b9d3-16cfee134093 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:55.133317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf86c9-99ab-4d2b-b9d3-16cfee134093 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:55.134774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 161/323] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:55.140825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc36e1b-b631-45d2-8fee-091781d70fd6 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:55.141148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc36e1b-b631-45d2-8fee-091781d70fd6 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:55.141432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc36e1b-b631-45d2-8fee-091781d70fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:55.159279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-9bc36e1b-b631-45d2-8fee-091781d70fd6 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:55.160737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9bc36e1b-b631-45d2-8fee-091781d70fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:55.232336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 163/324] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:55.254305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf86c9-99ab-4d2b-b9d3-16cfee134093 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:55.382511 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf86c9-99ab-4d2b-b9d3-16cfee134093 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:55.424508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842a508-3135-467d-98ee-68c1e31c0514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:55.425296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842a508-3135-467d-98ee-68c1e31c0514 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:55.425584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842a508-3135-467d-98ee-68c1e31c0514 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:55.425865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842a508-3135-467d-98ee-68c1e31c0514 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:55.442494 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842a508-3135-467d-98ee-68c1e31c0514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-a842a508-3135-467d-98ee-68c1e31c0514 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:55.451623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:55.452595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:55.453415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 162/325] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:55.460269 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc36e1b-b631-45d2-8fee-091781d70fd6 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:55.588629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc36e1b-b631-45d2-8fee-091781d70fd6 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:55.630823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eac8ae-63af-48ae-b55a-2c8a9b6c047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:55.631503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eac8ae-63af-48ae-b55a-2c8a9b6c047d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:55.631896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eac8ae-63af-48ae-b55a-2c8a9b6c047d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:55.632169 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eac8ae-63af-48ae-b55a-2c8a9b6c047d None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:55.632986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eac8ae-63af-48ae-b55a-2c8a9b6c047d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:55.633294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eac8ae-63af-48ae-b55a-2c8a9b6c047d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:55.634662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eac8ae-63af-48ae-b55a-2c8a9b6c047d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:55.644517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 164/326] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:55.653448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842a508-3135-467d-98ee-68c1e31c0514 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:55.729497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1129291-58bc-48d4-a45e-87fb3f72c03f None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:55.729698 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1129291-58bc-48d4-a45e-87fb3f72c03f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:55.730030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1129291-58bc-48d4-a45e-87fb3f72c03f None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:55.731663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 165/327] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:55.737550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb2426-79e7-4828-ad59-59949948a51a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:55.737765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb2426-79e7-4828-ad59-59949948a51a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:55.738029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb2426-79e7-4828-ad59-59949948a51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:55.757343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-efbb2426-79e7-4828-ad59-59949948a51a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:55.758541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-efbb2426-79e7-4828-ad59-59949948a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:55.761849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842a508-3135-467d-98ee-68c1e31c0514 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:55.801453 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a3020-c188-4c49-9157-2f930580ca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:55.802652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3020-c188-4c49-9157-2f930580ca2f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:55.803128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3020-c188-4c49-9157-2f930580ca2f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:55.803631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3020-c188-4c49-9157-2f930580ca2f None admin] PATH_INFO: `/v3/users/4b4fc3a937a94272ba759fc92449c17d` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:55.805079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a3020-c188-4c49-9157-2f930580ca2f None admin] RBAC: Authorizing `identity:get_user(user_id=4b4fc3a937a94272ba759fc92449c17d)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:55.806728 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a3020-c188-4c49-9157-2f930580ca2f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:55.809844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 163/328] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:55 2022] GET /identity/v3/users/4b4fc3a937a94272ba759fc92449c17d => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:55.815243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a3020-c188-4c49-9157-2f930580ca2f None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:55.833805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 166/329] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:55.859296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb2426-79e7-4828-ad59-59949948a51a None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:55.921743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a3020-c188-4c49-9157-2f930580ca2f None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:55.956872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b32cdb-4e6d-467e-bd27-406a86c66722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:55.957837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32cdb-4e6d-467e-bd27-406a86c66722 None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:55.958235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32cdb-4e6d-467e-bd27-406a86c66722 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:55.958587 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32cdb-4e6d-467e-bd27-406a86c66722 None admin] PATH_INFO: `/v3/system/users/4b4fc3a937a94272ba759fc92449c17d/roles/0566c059f03f4e44b3a4bad9cdba3cdc` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:55.960184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b32cdb-4e6d-467e-bd27-406a86c66722 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4b4fc3a937a94272ba759fc92449c17d, role_id=0566c059f03f4e44b3a4bad9cdba3cdc)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:55.961646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b32cdb-4e6d-467e-bd27-406a86c66722 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:55.962965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb2426-79e7-4828-ad59-59949948a51a None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:55.978263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 164/330] 10.222.0.72 () {58 vars in 1334 bytes} [Mon May 16 18:34:55 2022] PUT /identity/v3/system/users/4b4fc3a937a94272ba759fc92449c17d/roles/0566c059f03f4e44b3a4bad9cdba3cdc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:34:56.001233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28794e9f-e801-44f4-bc88-dc5bf25b9c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:56.002119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28794e9f-e801-44f4-bc88-dc5bf25b9c13 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:56.002408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28794e9f-e801-44f4-bc88-dc5bf25b9c13 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:56.002685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28794e9f-e801-44f4-bc88-dc5bf25b9c13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:56.016285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28794e9f-e801-44f4-bc88-dc5bf25b9c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-28794e9f-e801-44f4-bc88-dc5bf25b9c13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:56.024327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:56.025587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:56.026715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 167/331] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:34:56.032271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b32cdb-4e6d-467e-bd27-406a86c66722 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:56.141046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b32cdb-4e6d-467e-bd27-406a86c66722 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:56.184935 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af1ffc-9648-4a79-ae7d-7eb9fb6831e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:56.185629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af1ffc-9648-4a79-ae7d-7eb9fb6831e0 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:56.185916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af1ffc-9648-4a79-ae7d-7eb9fb6831e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:56.186201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af1ffc-9648-4a79-ae7d-7eb9fb6831e0 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:56.186972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af1ffc-9648-4a79-ae7d-7eb9fb6831e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:56.187284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af1ffc-9648-4a79-ae7d-7eb9fb6831e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:56.188710 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af1ffc-9648-4a79-ae7d-7eb9fb6831e0 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:56.205161 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 165/332] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:56.210735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28794e9f-e801-44f4-bc88-dc5bf25b9c13 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:56.327170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28794e9f-e801-44f4-bc88-dc5bf25b9c13 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:56.363485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b86654-ec0d-46e1-8b68-2766acfcd113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:56.364408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86654-ec0d-46e1-8b68-2766acfcd113 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:56.364690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86654-ec0d-46e1-8b68-2766acfcd113 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:56.364966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86654-ec0d-46e1-8b68-2766acfcd113 None admin] PATH_INFO: `/v3/users/aa35c39e2e7a416c9e06318701bb1665` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:56.366207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b86654-ec0d-46e1-8b68-2766acfcd113 None admin] RBAC: Authorizing `identity:get_user(user_id=aa35c39e2e7a416c9e06318701bb1665)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:56.367673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b86654-ec0d-46e1-8b68-2766acfcd113 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:56.369667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 168/333] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:34:56 2022] GET /identity/v3/users/aa35c39e2e7a416c9e06318701bb1665 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:56.375458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af1ffc-9648-4a79-ae7d-7eb9fb6831e0 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:56.481767 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af1ffc-9648-4a79-ae7d-7eb9fb6831e0 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:56.522170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf66b6b-bee6-4e87-93cc-44ad3fb54c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:56.522842 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf66b6b-bee6-4e87-93cc-44ad3fb54c0e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:56.523131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf66b6b-bee6-4e87-93cc-44ad3fb54c0e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:56.523416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf66b6b-bee6-4e87-93cc-44ad3fb54c0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:56.524304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf66b6b-bee6-4e87-93cc-44ad3fb54c0e None admin] RBAC: Adding query filter params (role.id=627af591fe55445c83abe50f753404c9, user.id=aa35c39e2e7a416c9e06318701bb1665, scope.system=all) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:56.524619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf66b6b-bee6-4e87-93cc-44ad3fb54c0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:56.526167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf66b6b-bee6-4e87-93cc-44ad3fb54c0e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:56.543419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 166/334] 10.222.0.72 () {56 vars in 1308 bytes} [Mon May 16 18:34:56 2022] GET /identity/v3/role_assignments?user.id=aa35c39e2e7a416c9e06318701bb1665&scope.system=all&role.id=627af591fe55445c83abe50f753404c9 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:58.236628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a08e0-c7f9-4b6a-8be0-beb4c5c80c24 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:58.237650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a08e0-c7f9-4b6a-8be0-beb4c5c80c24 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:58.238145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a08e0-c7f9-4b6a-8be0-beb4c5c80c24 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:58.240024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 169/335] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:58.257772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad949f-a0e9-4d45-8a0a-0bda5e6d7b78 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:58.258744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad949f-a0e9-4d45-8a0a-0bda5e6d7b78 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:58.259230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad949f-a0e9-4d45-8a0a-0bda5e6d7b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:58.279930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-17ad949f-a0e9-4d45-8a0a-0bda5e6d7b78 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:58.281481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-17ad949f-a0e9-4d45-8a0a-0bda5e6d7b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:58.365923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 167/336] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:58.406629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a08e0-c7f9-4b6a-8be0-beb4c5c80c24 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:58.526171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a08e0-c7f9-4b6a-8be0-beb4c5c80c24 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:58.561004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9387816-972a-4a9c-9d57-1ac94688d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:58.562192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387816-972a-4a9c-9d57-1ac94688d97d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:58.562683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387816-972a-4a9c-9d57-1ac94688d97d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:58.563166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387816-972a-4a9c-9d57-1ac94688d97d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:58.573851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9387816-972a-4a9c-9d57-1ac94688d97d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-d9387816-972a-4a9c-9d57-1ac94688d97d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:58.581875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:58.582766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:58.583555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:58.591163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 170/337] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:58.592808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad949f-a0e9-4d45-8a0a-0bda5e6d7b78 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:58.720721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad949f-a0e9-4d45-8a0a-0bda5e6d7b78 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:58.759120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3743c0-f4d6-4ae1-b0ae-491f84656e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:58.759819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3743c0-f4d6-4ae1-b0ae-491f84656e5d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:58.760105 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3743c0-f4d6-4ae1-b0ae-491f84656e5d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:58.760377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3743c0-f4d6-4ae1-b0ae-491f84656e5d None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:58.762089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3743c0-f4d6-4ae1-b0ae-491f84656e5d None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:58.762395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3743c0-f4d6-4ae1-b0ae-491f84656e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:58.763799 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3743c0-f4d6-4ae1-b0ae-491f84656e5d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:58.772628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 168/338] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:58.778385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9387816-972a-4a9c-9d57-1ac94688d97d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:58.940057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9387816-972a-4a9c-9d57-1ac94688d97d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:58.962104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d43d-8068-477b-86de-d35b59d56622 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:58.962382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d43d-8068-477b-86de-d35b59d56622 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:58.962906 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d43d-8068-477b-86de-d35b59d56622 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:58.964842 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 169/339] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:58.981852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd990-2a19-46a9-a353-a1f8584edbc5 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:58.982478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd990-2a19-46a9-a353-a1f8584edbc5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:58.982941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd990-2a19-46a9-a353-a1f8584edbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:58.987730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3157a-5de4-443c-848a-0b55a964bd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:58.987730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3157a-5de4-443c-848a-0b55a964bd50 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:58.987730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3157a-5de4-443c-848a-0b55a964bd50 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:58.987730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3157a-5de4-443c-848a-0b55a964bd50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:59.016704 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-3cedd990-2a19-46a9-a353-a1f8584edbc5 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:59.018275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3cedd990-2a19-46a9-a353-a1f8584edbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:59.087175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3157a-5de4-443c-848a-0b55a964bd50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:59.089086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3157a-5de4-443c-848a-0b55a964bd50 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:59.184476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 170/340] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:59.185848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b048c1-9a43-4770-a054-d19906c9b643 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:59.186135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b048c1-9a43-4770-a054-d19906c9b643 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:59.186413 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b048c1-9a43-4770-a054-d19906c9b643 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:59.187671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 171/341] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:59.188747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d80ead-1a62-4ace-bbcc-4d7b7a37a0e4 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:59.189058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d80ead-1a62-4ace-bbcc-4d7b7a37a0e4 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:59.189294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d80ead-1a62-4ace-bbcc-4d7b7a37a0e4 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:59.190776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 172/342] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:34:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:34:59.192882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704cf7-8d4a-4330-830b-e9f8c9c9c445 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:59.193165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704cf7-8d4a-4330-830b-e9f8c9c9c445 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:59.193440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704cf7-8d4a-4330-830b-e9f8c9c9c445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:59.228687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1b704cf7-8d4a-4330-830b-e9f8c9c9c445 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:59.229931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1b704cf7-8d4a-4330-830b-e9f8c9c9c445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:59.233877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 171/343] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:34:59.235358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9a664-f0c2-4dc0-871f-d9c78a55b50a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:59.235647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9a664-f0c2-4dc0-871f-d9c78a55b50a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:59.235955 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9a664-f0c2-4dc0-871f-d9c78a55b50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:59.253389 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-4da9a664-f0c2-4dc0-871f-d9c78a55b50a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:34:59.254579 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4da9a664-f0c2-4dc0-871f-d9c78a55b50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:34:59.313633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 173/344] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:34:59.315175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b704cf7-8d4a-4330-830b-e9f8c9c9c445 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:59.336684 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 172/345] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:34:59.337616 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9a664-f0c2-4dc0-871f-d9c78a55b50a None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:59.421080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b704cf7-8d4a-4330-830b-e9f8c9c9c445 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:59.456160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76a2b0-64d0-4f11-90f1-3e67735f241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:59.457230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76a2b0-64d0-4f11-90f1-3e67735f241e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:59.457658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76a2b0-64d0-4f11-90f1-3e67735f241e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:59.458087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76a2b0-64d0-4f11-90f1-3e67735f241e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:59.468596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9a664-f0c2-4dc0-871f-d9c78a55b50a None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:59.470218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76a2b0-64d0-4f11-90f1-3e67735f241e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-8f76a2b0-64d0-4f11-90f1-3e67735f241e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:59.479277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:59.480955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:34:59.481840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:59.483894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 174/346] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:34:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:59.484952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76a2b0-64d0-4f11-90f1-3e67735f241e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:59.511251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4fe41-177d-470f-805c-8213af2e425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:59.511948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4fe41-177d-470f-805c-8213af2e425d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:59.512321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4fe41-177d-470f-805c-8213af2e425d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:59.512508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4fe41-177d-470f-805c-8213af2e425d None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:59.513911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4fe41-177d-470f-805c-8213af2e425d None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:59.515650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4fe41-177d-470f-805c-8213af2e425d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:59.523751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 173/347] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:34:59 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:59.523751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4fe41-177d-470f-805c-8213af2e425d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:59.601472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76a2b0-64d0-4f11-90f1-3e67735f241e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:59.632368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4fe41-177d-470f-805c-8213af2e425d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:59.638735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c85b68-dac2-4608-a3bb-1fd12de95f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:59.639801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c85b68-dac2-4608-a3bb-1fd12de95f43 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:59.640249 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c85b68-dac2-4608-a3bb-1fd12de95f43 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:59.640670 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c85b68-dac2-4608-a3bb-1fd12de95f43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:59.651480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c85b68-dac2-4608-a3bb-1fd12de95f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-69c85b68-dac2-4608-a3bb-1fd12de95f43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:59.660202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:59.661337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:59.662245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:34:59.664647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 175/348] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:34:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:59.665697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c85b68-dac2-4608-a3bb-1fd12de95f43 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:59.670230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35845286-21fd-4013-baeb-9128d311d21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:59.671053 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35845286-21fd-4013-baeb-9128d311d21b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:59.671390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35845286-21fd-4013-baeb-9128d311d21b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:59.671671 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35845286-21fd-4013-baeb-9128d311d21b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:59.683475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35845286-21fd-4013-baeb-9128d311d21b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-35845286-21fd-4013-baeb-9128d311d21b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:34:59.691969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:34:59.693067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:34:59.694066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 174/349] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:34:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:34:59.694798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35845286-21fd-4013-baeb-9128d311d21b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:59.779666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c85b68-dac2-4608-a3bb-1fd12de95f43 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:59.805102 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35845286-21fd-4013-baeb-9128d311d21b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:59.815829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d696d6-80c0-481c-9b83-7f82d539a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:59.816510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d696d6-80c0-481c-9b83-7f82d539a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:59.816792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d696d6-80c0-481c-9b83-7f82d539a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:59.817063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d696d6-80c0-481c-9b83-7f82d539a7e1 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:59.817822 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d696d6-80c0-481c-9b83-7f82d539a7e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:34:59.818125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d696d6-80c0-481c-9b83-7f82d539a7e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:59.819502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d696d6-80c0-481c-9b83-7f82d539a7e1 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:59.829647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 176/350] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:34:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:59.830992 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d696d6-80c0-481c-9b83-7f82d539a7e1 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:59.845948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee379d5a-0f68-4ff0-ace8-ab3962b75317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:34:59.846905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee379d5a-0f68-4ff0-ace8-ab3962b75317 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:34:59.847201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee379d5a-0f68-4ff0-ace8-ab3962b75317 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:34:59.847479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee379d5a-0f68-4ff0-ace8-ab3962b75317 None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:34:59.857420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee379d5a-0f68-4ff0-ace8-ab3962b75317 None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:34:59.859482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee379d5a-0f68-4ff0-ace8-ab3962b75317 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:34:59.862672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 175/351] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:34:59 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:34:59.864261 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee379d5a-0f68-4ff0-ace8-ab3962b75317 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:34:59.963354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d696d6-80c0-481c-9b83-7f82d539a7e1 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:34:59.988633 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee379d5a-0f68-4ff0-ace8-ab3962b75317 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:00.001602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aa812-a063-4923-b768-e8d8e79b1928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:00.002456 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aa812-a063-4923-b768-e8d8e79b1928 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:00.002750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aa812-a063-4923-b768-e8d8e79b1928 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:00.003466 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aa812-a063-4923-b768-e8d8e79b1928 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:00.004559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74aa812-a063-4923-b768-e8d8e79b1928 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:00.004875 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74aa812-a063-4923-b768-e8d8e79b1928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:00.006490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74aa812-a063-4923-b768-e8d8e79b1928 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:00.016015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 177/352] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:34:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:00.017128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec4c01-412b-4484-815d-204a0e7baf08 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:00.017421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec4c01-412b-4484-815d-204a0e7baf08 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:00.017703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec4c01-412b-4484-815d-204a0e7baf08 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:00.023784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 178/353] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:00.023784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec4c01-412b-4484-815d-204a0e7baf08 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:00.031325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcd306-d085-4d2a-90ec-b729fd872e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:00.032052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcd306-d085-4d2a-90ec-b729fd872e4b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:00.032329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcd306-d085-4d2a-90ec-b729fd872e4b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:00.032604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcd306-d085-4d2a-90ec-b729fd872e4b None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:00.033364 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcd306-d085-4d2a-90ec-b729fd872e4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:00.033667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcd306-d085-4d2a-90ec-b729fd872e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:00.035040 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcd306-d085-4d2a-90ec-b729fd872e4b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:00.047595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 176/354] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:34:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:00.052756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcd306-d085-4d2a-90ec-b729fd872e4b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:00.175569 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec4c01-412b-4484-815d-204a0e7baf08 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:00.186984 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcd306-d085-4d2a-90ec-b729fd872e4b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:00.218832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbe87a-d506-494e-af28-78181869d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:00.219492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbe87a-d506-494e-af28-78181869d97b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:00.219817 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbe87a-d506-494e-af28-78181869d97b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:00.220095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbe87a-d506-494e-af28-78181869d97b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:00.232380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2995d9-6e43-4e9f-9033-0d174424276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:00.233055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2995d9-6e43-4e9f-9033-0d174424276b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:00.233370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2995d9-6e43-4e9f-9033-0d174424276b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:00.233647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2995d9-6e43-4e9f-9033-0d174424276b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:00.234500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2995d9-6e43-4e9f-9033-0d174424276b None admin] RBAC: Adding query filter params (group.id=6e303d40d97447e18c6fd9239bd4ca7a, role.id=627af591fe55445c83abe50f753404c9, scope.project.id=3c0793f1f4e4422f921a1d20504a3726) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:00.234811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2995d9-6e43-4e9f-9033-0d174424276b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:00.236321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2995d9-6e43-4e9f-9033-0d174424276b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:00.243536 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 177/355] 10.222.0.72 () {56 vars in 1376 bytes} [Mon May 16 18:35:00 2022] GET /identity/v3/role_assignments?group.id=6e303d40d97447e18c6fd9239bd4ca7a&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=627af591fe55445c83abe50f753404c9 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:00.244827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2995d9-6e43-4e9f-9033-0d174424276b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:00.327090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbe87a-d506-494e-af28-78181869d97b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:00.328672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbe87a-d506-494e-af28-78181869d97b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:00.387266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2995d9-6e43-4e9f-9033-0d174424276b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:00.435987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aae1a5-e76d-4047-afc6-c1e86d1b875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:00.436580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aae1a5-e76d-4047-afc6-c1e86d1b875b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:00.436867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aae1a5-e76d-4047-afc6-c1e86d1b875b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:00.437149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aae1a5-e76d-4047-afc6-c1e86d1b875b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:00.463063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 179/356] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:00.464193 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bcb5b-fd0b-443d-8228-24b9db2f411b None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:00.464491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bcb5b-fd0b-443d-8228-24b9db2f411b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:00.464775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bcb5b-fd0b-443d-8228-24b9db2f411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:00.483456 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-c84bcb5b-fd0b-443d-8228-24b9db2f411b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:00.484766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c84bcb5b-fd0b-443d-8228-24b9db2f411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:00.518718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aae1a5-e76d-4047-afc6-c1e86d1b875b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:00.520588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aae1a5-e76d-4047-afc6-c1e86d1b875b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:00.572580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 180/357] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:00.574123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bcb5b-fd0b-443d-8228-24b9db2f411b None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:00.639922 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 178/358] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:00.640884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751331e-95ec-4014-a1c2-358eee068239 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:00.641170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751331e-95ec-4014-a1c2-358eee068239 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:00.641442 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751331e-95ec-4014-a1c2-358eee068239 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:00.642883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 179/359] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:00.648737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751331e-95ec-4014-a1c2-358eee068239 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:00.711021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bcb5b-fd0b-443d-8228-24b9db2f411b None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:00.755109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95796d1-e41d-476b-b60a-e61f2753c03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:00.755439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95796d1-e41d-476b-b60a-e61f2753c03e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:00.755669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95796d1-e41d-476b-b60a-e61f2753c03e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:00.756046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95796d1-e41d-476b-b60a-e61f2753c03e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:00.773531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751331e-95ec-4014-a1c2-358eee068239 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:00.814525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af144c-15df-478a-9b50-c90a0040e196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:00.815392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af144c-15df-478a-9b50-c90a0040e196 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:00.815671 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af144c-15df-478a-9b50-c90a0040e196 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:00.818043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af144c-15df-478a-9b50-c90a0040e196 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:00.819691 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af144c-15df-478a-9b50-c90a0040e196 None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:00.821011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af144c-15df-478a-9b50-c90a0040e196 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:00.825471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 180/360] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:00 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:00.825761 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af144c-15df-478a-9b50-c90a0040e196 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:00.848621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95796d1-e41d-476b-b60a-e61f2753c03e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:00.849292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95796d1-e41d-476b-b60a-e61f2753c03e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:00.952752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af144c-15df-478a-9b50-c90a0040e196 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:00.985904 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 181/361] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:00.986756 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95796d1-e41d-476b-b60a-e61f2753c03e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:01.000039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21585d5a-9dec-497a-accd-231d080cd1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:01.001171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21585d5a-9dec-497a-accd-231d080cd1b9 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:01.001643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21585d5a-9dec-497a-accd-231d080cd1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:01.002113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21585d5a-9dec-497a-accd-231d080cd1b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:01.014657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21585d5a-9dec-497a-accd-231d080cd1b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-21585d5a-9dec-497a-accd-231d080cd1b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:01.023521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:01.024597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 18:35:01.025608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:01.028462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 181/362] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:01.029830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f85e-72d6-4cb4-a3a0-b348bae6bc7c None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:01.030117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f85e-72d6-4cb4-a3a0-b348bae6bc7c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:01.030389 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f85e-72d6-4cb4-a3a0-b348bae6bc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:01.056918 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8ed5f85e-72d6-4cb4-a3a0-b348bae6bc7c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:01.058285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8ed5f85e-72d6-4cb4-a3a0-b348bae6bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:01.099971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95796d1-e41d-476b-b60a-e61f2753c03e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:01.141701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 182/363] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:01.141701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f85e-72d6-4cb4-a3a0-b348bae6bc7c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:01.147093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f62d18-8f14-401e-b63f-54b1724dba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:01.148622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f62d18-8f14-401e-b63f-54b1724dba5c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:01.148622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f62d18-8f14-401e-b63f-54b1724dba5c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:01.148622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f62d18-8f14-401e-b63f-54b1724dba5c None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:01.150670 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f62d18-8f14-401e-b63f-54b1724dba5c None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:01.153278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f62d18-8f14-401e-b63f-54b1724dba5c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:01.159793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 182/364] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:00 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:01.160897 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f62d18-8f14-401e-b63f-54b1724dba5c None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:01.274967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f85e-72d6-4cb4-a3a0-b348bae6bc7c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:01.281946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f62d18-8f14-401e-b63f-54b1724dba5c None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:01.314525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349236c-428b-4486-aca7-4177dfca87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:01.315548 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349236c-428b-4486-aca7-4177dfca87a6 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:01.316199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349236c-428b-4486-aca7-4177dfca87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:01.316474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349236c-428b-4486-aca7-4177dfca87a6 None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:01.318079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349236c-428b-4486-aca7-4177dfca87a6 None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:01.319838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349236c-428b-4486-aca7-4177dfca87a6 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:01.321872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 183/365] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:01 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:01.322629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349236c-428b-4486-aca7-4177dfca87a6 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:01.325311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e54563-8beb-414c-a233-de6a307ab575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:01.326301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e54563-8beb-414c-a233-de6a307ab575 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:01.327480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e54563-8beb-414c-a233-de6a307ab575 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:01.327480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e54563-8beb-414c-a233-de6a307ab575 None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:01.328390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e54563-8beb-414c-a233-de6a307ab575 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:01.330953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e54563-8beb-414c-a233-de6a307ab575 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:01.333777 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 183/366] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:01 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:01.334684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e54563-8beb-414c-a233-de6a307ab575 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:01.453890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349236c-428b-4486-aca7-4177dfca87a6 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:01.476918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e54563-8beb-414c-a233-de6a307ab575 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:01.495603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d252493-66b5-48bc-a9b2-8a96d8a0a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:01.496324 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d252493-66b5-48bc-a9b2-8a96d8a0a38a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:01.496601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d252493-66b5-48bc-a9b2-8a96d8a0a38a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:01.496872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d252493-66b5-48bc-a9b2-8a96d8a0a38a None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:01.497626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d252493-66b5-48bc-a9b2-8a96d8a0a38a None admin] RBAC: Adding query filter params (name=reader) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:01.497930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d252493-66b5-48bc-a9b2-8a96d8a0a38a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:01.499284 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d252493-66b5-48bc-a9b2-8a96d8a0a38a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:01.507746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 184/367] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:35:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:01.508679 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d252493-66b5-48bc-a9b2-8a96d8a0a38a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:01.521550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0460714-354a-4782-bcf6-1e1940893da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:01.522667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460714-354a-4782-bcf6-1e1940893da5 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:01.522950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460714-354a-4782-bcf6-1e1940893da5 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:01.523225 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460714-354a-4782-bcf6-1e1940893da5 None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:01.524428 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0460714-354a-4782-bcf6-1e1940893da5 None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:01.525941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0460714-354a-4782-bcf6-1e1940893da5 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:01.533310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 184/368] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:01 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:01.533310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0460714-354a-4782-bcf6-1e1940893da5 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:01.623648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d252493-66b5-48bc-a9b2-8a96d8a0a38a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:01.627423 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0460714-354a-4782-bcf6-1e1940893da5 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:01.661107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd6408-308c-4df1-a566-6693e6273944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:01.661570 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd3852-dc3a-4333-adbe-9b74f31ed873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:01.661804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd6408-308c-4df1-a566-6693e6273944 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:01.662044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd6408-308c-4df1-a566-6693e6273944 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:01.662319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd6408-308c-4df1-a566-6693e6273944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:01.662414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd3852-dc3a-4333-adbe-9b74f31ed873 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:01.662634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd3852-dc3a-4333-adbe-9b74f31ed873 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:01.662911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd3852-dc3a-4333-adbe-9b74f31ed873 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:01.663154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd6408-308c-4df1-a566-6693e6273944 None admin] RBAC: Adding query filter params (group.id=6e303d40d97447e18c6fd9239bd4ca7a, role.id=627af591fe55445c83abe50f753404c9, scope.project.id=631886c48e954289908b5e89ccf44d8e) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:01.663464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd6408-308c-4df1-a566-6693e6273944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:01.664949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd6408-308c-4df1-a566-6693e6273944 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:01.680060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 185/369] 10.222.0.72 () {56 vars in 1376 bytes} [Mon May 16 18:35:01 2022] GET /identity/v3/role_assignments?group.id=6e303d40d97447e18c6fd9239bd4ca7a&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=627af591fe55445c83abe50f753404c9 => generated 260 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:01.680060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd6408-308c-4df1-a566-6693e6273944 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:01.680357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd3852-dc3a-4333-adbe-9b74f31ed873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-fdfd3852-dc3a-4333-adbe-9b74f31ed873 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:01.683853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:01.684852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:01.685636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:01.686805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 185/370] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:01.687650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd3852-dc3a-4333-adbe-9b74f31ed873 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:01.809710 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd3852-dc3a-4333-adbe-9b74f31ed873 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:01.811650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd6408-308c-4df1-a566-6693e6273944 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:01.846714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8edbb-6a0a-4817-8c86-b88df2f8f798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:01.847609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8edbb-6a0a-4817-8c86-b88df2f8f798 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:01.847941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8edbb-6a0a-4817-8c86-b88df2f8f798 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:01.848221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8edbb-6a0a-4817-8c86-b88df2f8f798 None admin] PATH_INFO: `/v3/users/4b4fc3a937a94272ba759fc92449c17d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:01.849486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8edbb-6a0a-4817-8c86-b88df2f8f798 None admin] RBAC: Authorizing `identity:get_user(user_id=4b4fc3a937a94272ba759fc92449c17d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:01.850962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8edbb-6a0a-4817-8c86-b88df2f8f798 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:01.852928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 186/371] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:35:01 2022] GET /identity/v3/users/4b4fc3a937a94272ba759fc92449c17d => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:01.853447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8edbb-6a0a-4817-8c86-b88df2f8f798 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:01.854045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929d0d8-6a5b-4e64-b814-c314e05d4253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:01.855623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929d0d8-6a5b-4e64-b814-c314e05d4253 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:01.855953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929d0d8-6a5b-4e64-b814-c314e05d4253 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:01.856228 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929d0d8-6a5b-4e64-b814-c314e05d4253 None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:01.858601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929d0d8-6a5b-4e64-b814-c314e05d4253 None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:01.860113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929d0d8-6a5b-4e64-b814-c314e05d4253 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:01.862108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 186/372] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:01 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:01.862901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929d0d8-6a5b-4e64-b814-c314e05d4253 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:01.978567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8edbb-6a0a-4817-8c86-b88df2f8f798 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:01.986027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929d0d8-6a5b-4e64-b814-c314e05d4253 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:02.016487 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8bbb3-7817-4b09-bbb5-4201ce34aa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:02.017436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8bbb3-7817-4b09-bbb5-4201ce34aa70 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:02.017893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8bbb3-7817-4b09-bbb5-4201ce34aa70 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:02.018367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8bbb3-7817-4b09-bbb5-4201ce34aa70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:02.019390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8bbb3-7817-4b09-bbb5-4201ce34aa70 None admin] RBAC: Adding query filter params (group.id=6e303d40d97447e18c6fd9239bd4ca7a, role.id=004dfaca095a4141ae157de95aa6390a, scope.project.id=631886c48e954289908b5e89ccf44d8e) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:02.019931 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8bbb3-7817-4b09-bbb5-4201ce34aa70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:02.021532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8bbb3-7817-4b09-bbb5-4201ce34aa70 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:02.027061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0093c8e-5ebe-4fc2-879c-fd78ca8acbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:02.027952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0093c8e-5ebe-4fc2-879c-fd78ca8acbd3 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:02.028136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0093c8e-5ebe-4fc2-879c-fd78ca8acbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:02.028330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 187/373] 10.222.0.72 () {56 vars in 1376 bytes} [Mon May 16 18:35:01 2022] GET /identity/v3/role_assignments?group.id=6e303d40d97447e18c6fd9239bd4ca7a&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=004dfaca095a4141ae157de95aa6390a => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:02.028491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0093c8e-5ebe-4fc2-879c-fd78ca8acbd3 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:02.029292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0093c8e-5ebe-4fc2-879c-fd78ca8acbd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:02.029606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0093c8e-5ebe-4fc2-879c-fd78ca8acbd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:02.029898 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8bbb3-7817-4b09-bbb5-4201ce34aa70 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:02.031004 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0093c8e-5ebe-4fc2-879c-fd78ca8acbd3 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:02.043156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 187/374] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:02.044508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0093c8e-5ebe-4fc2-879c-fd78ca8acbd3 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:02.141581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8bbb3-7817-4b09-bbb5-4201ce34aa70 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:02.175510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0093c8e-5ebe-4fc2-879c-fd78ca8acbd3 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:02.197292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e0217-de21-4bcd-bf9f-9a76f111d887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:02.198459 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e0217-de21-4bcd-bf9f-9a76f111d887 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:02.199089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e0217-de21-4bcd-bf9f-9a76f111d887 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:02.199608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e0217-de21-4bcd-bf9f-9a76f111d887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:02.200736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e0217-de21-4bcd-bf9f-9a76f111d887 None admin] RBAC: Adding query filter params (role.id=0566c059f03f4e44b3a4bad9cdba3cdc, user.id=4b4fc3a937a94272ba759fc92449c17d, scope.system=all) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:02.202353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e0217-de21-4bcd-bf9f-9a76f111d887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:02.204629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e0217-de21-4bcd-bf9f-9a76f111d887 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:02.223781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 188/375] 10.222.0.72 () {56 vars in 1308 bytes} [Mon May 16 18:35:02 2022] GET /identity/v3/role_assignments?user.id=4b4fc3a937a94272ba759fc92449c17d&scope.system=all&role.id=0566c059f03f4e44b3a4bad9cdba3cdc => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:02.225060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e0217-de21-4bcd-bf9f-9a76f111d887 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:02.256713 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a236fa-4f23-434c-a0a0-8c7d0f4bf472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:02.257806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a236fa-4f23-434c-a0a0-8c7d0f4bf472 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:02.258366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a236fa-4f23-434c-a0a0-8c7d0f4bf472 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:02.258846 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a236fa-4f23-434c-a0a0-8c7d0f4bf472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:02.260057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a236fa-4f23-434c-a0a0-8c7d0f4bf472 None admin] RBAC: Adding query filter params (group.id=6e303d40d97447e18c6fd9239bd4ca7a, role.id=004dfaca095a4141ae157de95aa6390a, scope.project.id=3c0793f1f4e4422f921a1d20504a3726) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:02.262196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a236fa-4f23-434c-a0a0-8c7d0f4bf472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:02.264107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a236fa-4f23-434c-a0a0-8c7d0f4bf472 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:02.281182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 188/376] 10.222.0.72 () {56 vars in 1376 bytes} [Mon May 16 18:35:02 2022] GET /identity/v3/role_assignments?group.id=6e303d40d97447e18c6fd9239bd4ca7a&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=004dfaca095a4141ae157de95aa6390a => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:02.406914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e0217-de21-4bcd-bf9f-9a76f111d887 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:02.453075 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fffa2-232f-4d73-b478-01972ba68b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:02.453748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fffa2-232f-4d73-b478-01972ba68b33 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:02.454025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fffa2-232f-4d73-b478-01972ba68b33 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:02.454592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fffa2-232f-4d73-b478-01972ba68b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:02.528563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fffa2-232f-4d73-b478-01972ba68b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:02.530045 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fffa2-232f-4d73-b478-01972ba68b33 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:02.641755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 189/377] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:02.647399 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a236fa-4f23-434c-a0a0-8c7d0f4bf472 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:02.785835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a236fa-4f23-434c-a0a0-8c7d0f4bf472 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:02.825871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eca5e-96f2-4fd8-b1c3-5f97eecc2c0a None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:02.826089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe9a98-9df4-4bc8-9555-e0b4f9650212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:02.826187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eca5e-96f2-4fd8-b1c3-5f97eecc2c0a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:02.826431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eca5e-96f2-4fd8-b1c3-5f97eecc2c0a None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:02.826963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe9a98-9df4-4bc8-9555-e0b4f9650212 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:02.827250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe9a98-9df4-4bc8-9555-e0b4f9650212 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:02.827531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe9a98-9df4-4bc8-9555-e0b4f9650212 None admin] PATH_INFO: `/v3/projects/44adac522ccb43149dbafba14f75fd72` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:02.829310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 190/378] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:02.830745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe9a98-9df4-4bc8-9555-e0b4f9650212 None admin] RBAC: Authorizing `identity:get_project(project_id=44adac522ccb43149dbafba14f75fd72)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:02.832359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe9a98-9df4-4bc8-9555-e0b4f9650212 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:02.834347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 189/379] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:02 2022] GET /identity/v3/projects/44adac522ccb43149dbafba14f75fd72 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:02.834589 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd676ad-765c-4a36-9bb4-0f636535f01f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:02.834874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd676ad-765c-4a36-9bb4-0f636535f01f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:02.835148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd676ad-765c-4a36-9bb4-0f636535f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:02.841356 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe9a98-9df4-4bc8-9555-e0b4f9650212 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:02.876714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-dfd676ad-765c-4a36-9bb4-0f636535f01f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:02.877905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-dfd676ad-765c-4a36-9bb4-0f636535f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:02.984793 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 191/380] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:35:03.003490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe9a98-9df4-4bc8-9555-e0b4f9650212 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:03.030840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd676ad-765c-4a36-9bb4-0f636535f01f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:03.048042 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a79b93-f14c-4aa0-83a2-e8200fbea09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:03.049190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a79b93-f14c-4aa0-83a2-e8200fbea09f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:03.049659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a79b93-f14c-4aa0-83a2-e8200fbea09f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:03.050120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a79b93-f14c-4aa0-83a2-e8200fbea09f None admin] PATH_INFO: `/v3/groups/22e32e5ae49d4f49913a8d32ecf6164f` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:03.064045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a79b93-f14c-4aa0-83a2-e8200fbea09f None admin] RBAC: Authorizing `identity:get_group(group_id=22e32e5ae49d4f49913a8d32ecf6164f)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:03.065817 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a79b93-f14c-4aa0-83a2-e8200fbea09f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:03.068169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 190/381] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:02 2022] GET /identity/v3/groups/22e32e5ae49d4f49913a8d32ecf6164f => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:03.077584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a79b93-f14c-4aa0-83a2-e8200fbea09f None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:03.220798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd676ad-765c-4a36-9bb4-0f636535f01f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:03.259587 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a79b93-f14c-4aa0-83a2-e8200fbea09f None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:03.287259 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dee4d-5558-4544-9dee-fd843d2f35f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:03.288384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dee4d-5558-4544-9dee-fd843d2f35f2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:03.288846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dee4d-5558-4544-9dee-fd843d2f35f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:03.289298 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dee4d-5558-4544-9dee-fd843d2f35f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:03.308213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dee4d-5558-4544-9dee-fd843d2f35f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-310dee4d-5558-4544-9dee-fd843d2f35f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:03.321025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:03.321960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:35:03.322749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:03.326728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 192/382] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:03.327513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb509886-b2c7-4988-8c67-e29910466b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:03.328427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb509886-b2c7-4988-8c67-e29910466b6e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:03.328855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb509886-b2c7-4988-8c67-e29910466b6e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:03.329302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb509886-b2c7-4988-8c67-e29910466b6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:03.330288 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb509886-b2c7-4988-8c67-e29910466b6e None admin] RBAC: Adding query filter params (group.id=22e32e5ae49d4f49913a8d32ecf6164f, role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=44adac522ccb43149dbafba14f75fd72) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:03.330746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb509886-b2c7-4988-8c67-e29910466b6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:03.332388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb509886-b2c7-4988-8c67-e29910466b6e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:03.333334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dee4d-5558-4544-9dee-fd843d2f35f2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:03.343668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 191/383] 10.222.0.72 () {56 vars in 1376 bytes} [Mon May 16 18:35:03 2022] GET /identity/v3/role_assignments?group.id=22e32e5ae49d4f49913a8d32ecf6164f&scope.project.id=44adac522ccb43149dbafba14f75fd72&role.id=b104fd2e772843a0974990f965d8b589 => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:03.467614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dee4d-5558-4544-9dee-fd843d2f35f2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:03.517558 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48188d-cf6a-4f05-ac03-10f8e5b16549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:03.518636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48188d-cf6a-4f05-ac03-10f8e5b16549 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:03.519113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48188d-cf6a-4f05-ac03-10f8e5b16549 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:03.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48188d-cf6a-4f05-ac03-10f8e5b16549 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:03.520520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48188d-cf6a-4f05-ac03-10f8e5b16549 None admin] RBAC: Adding query filter params (name=member) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:03.520972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48188d-cf6a-4f05-ac03-10f8e5b16549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:03.522531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48188d-cf6a-4f05-ac03-10f8e5b16549 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:03.532801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 193/384] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:35:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:03.538533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb509886-b2c7-4988-8c67-e29910466b6e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:03.658981 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb509886-b2c7-4988-8c67-e29910466b6e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:03.699418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892bf65-0f65-4b3d-b0e6-f7521a6b5f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:03.700637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892bf65-0f65-4b3d-b0e6-f7521a6b5f43 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:03.701086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892bf65-0f65-4b3d-b0e6-f7521a6b5f43 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:03.701512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892bf65-0f65-4b3d-b0e6-f7521a6b5f43 None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:03.702871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892bf65-0f65-4b3d-b0e6-f7521a6b5f43 None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:03.704498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892bf65-0f65-4b3d-b0e6-f7521a6b5f43 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:03.706635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 192/385] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:03 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:03.712760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48188d-cf6a-4f05-ac03-10f8e5b16549 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:03.821497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48188d-cf6a-4f05-ac03-10f8e5b16549 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:03.867947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc39ea1-119f-49cf-bf28-cca68129695d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:03.869066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc39ea1-119f-49cf-bf28-cca68129695d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:03.869525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc39ea1-119f-49cf-bf28-cca68129695d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:03.869956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc39ea1-119f-49cf-bf28-cca68129695d None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:03.876435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc39ea1-119f-49cf-bf28-cca68129695d None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:03.878036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc39ea1-119f-49cf-bf28-cca68129695d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:03.879927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 194/386] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:03 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:03.885585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892bf65-0f65-4b3d-b0e6-f7521a6b5f43 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:04.015490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892bf65-0f65-4b3d-b0e6-f7521a6b5f43 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:04.060983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abdf81-2db0-4f15-ba59-05f775e7b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:04.061877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abdf81-2db0-4f15-ba59-05f775e7b198 None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:04.062214 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abdf81-2db0-4f15-ba59-05f775e7b198 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:04.062499 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abdf81-2db0-4f15-ba59-05f775e7b198 None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726/groups/6e303d40d97447e18c6fd9239bd4ca7a/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:04.069017 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abdf81-2db0-4f15-ba59-05f775e7b198 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0793f1f4e4422f921a1d20504a3726, group_id=6e303d40d97447e18c6fd9239bd4ca7a, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:04.070477 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abdf81-2db0-4f15-ba59-05f775e7b198 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:04.096720 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 193/387] 10.222.0.72 () {58 vars in 1442 bytes} [Mon May 16 18:35:03 2022] PUT /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726/groups/6e303d40d97447e18c6fd9239bd4ca7a/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:35:04.412480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181bec4-a4ce-4264-aa80-e00224e6417b None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:04.412857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181bec4-a4ce-4264-aa80-e00224e6417b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:04.413039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181bec4-a4ce-4264-aa80-e00224e6417b None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:04.414687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 195/388] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:04.420641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801ab03-beaa-4625-aeee-0c610a01a8ba None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:04.420941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801ab03-beaa-4625-aeee-0c610a01a8ba None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:04.421230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801ab03-beaa-4625-aeee-0c610a01a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:04.438926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-c801ab03-beaa-4625-aeee-0c610a01a8ba None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:04.440166 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c801ab03-beaa-4625-aeee-0c610a01a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:04.510679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 194/389] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:04.541574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181bec4-a4ce-4264-aa80-e00224e6417b None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:04.676464 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181bec4-a4ce-4264-aa80-e00224e6417b None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:04.722213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291758f-b0de-4aee-84c9-4e0d0372b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:04.723362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291758f-b0de-4aee-84c9-4e0d0372b312 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:04.723865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291758f-b0de-4aee-84c9-4e0d0372b312 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:04.724387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291758f-b0de-4aee-84c9-4e0d0372b312 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:04.744587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291758f-b0de-4aee-84c9-4e0d0372b312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-d291758f-b0de-4aee-84c9-4e0d0372b312 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:04.753134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:04.754018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:35:04.754795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:04.757450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 196/390] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:04.763997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801ab03-beaa-4625-aeee-0c610a01a8ba None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:04.903309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801ab03-beaa-4625-aeee-0c610a01a8ba None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:04.954744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3c02b-cbfc-486c-809d-c378ee311b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:04.955434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c02b-cbfc-486c-809d-c378ee311b05 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:04.955735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c02b-cbfc-486c-809d-c378ee311b05 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:04.956030 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c02b-cbfc-486c-809d-c378ee311b05 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:04.956800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3c02b-cbfc-486c-809d-c378ee311b05 None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:04.957109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3c02b-cbfc-486c-809d-c378ee311b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:04.958486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3c02b-cbfc-486c-809d-c378ee311b05 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:04.971849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 195/391] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:35:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:04.977498 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291758f-b0de-4aee-84c9-4e0d0372b312 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:05.051591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c31882-e272-4dfd-ae68-ea54d5b37830 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:05.051925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c31882-e272-4dfd-ae68-ea54d5b37830 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:05.052185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c31882-e272-4dfd-ae68-ea54d5b37830 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:05.053556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 196/392] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:05.059077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68d5d5-acf7-4284-a13f-69c5d1d4428f None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:05.059374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68d5d5-acf7-4284-a13f-69c5d1d4428f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:05.059657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68d5d5-acf7-4284-a13f-69c5d1d4428f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:05.086905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-2b68d5d5-acf7-4284-a13f-69c5d1d4428f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:05.089842 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2b68d5d5-acf7-4284-a13f-69c5d1d4428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:05.136557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291758f-b0de-4aee-84c9-4e0d0372b312 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:05.196004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6bf74-2af3-49df-8ca1-d938463908e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:05.197096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6bf74-2af3-49df-8ca1-d938463908e8 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:05.197525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6bf74-2af3-49df-8ca1-d938463908e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:05.197966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6bf74-2af3-49df-8ca1-d938463908e8 None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:05.201209 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6bf74-2af3-49df-8ca1-d938463908e8 None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:05.204024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6bf74-2af3-49df-8ca1-d938463908e8 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:05.205764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 197/393] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:04 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:05.211018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 197/394] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:05.219760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6bf74-2af3-49df-8ca1-d938463908e8 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:05.235029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68d5d5-acf7-4284-a13f-69c5d1d4428f None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:05.356144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68d5d5-acf7-4284-a13f-69c5d1d4428f None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:05.394190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6870d29-7541-4b94-bed3-250cc3fe5e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:05.395014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870d29-7541-4b94-bed3-250cc3fe5e59 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:05.395296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870d29-7541-4b94-bed3-250cc3fe5e59 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:05.395573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870d29-7541-4b94-bed3-250cc3fe5e59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:05.412547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6870d29-7541-4b94-bed3-250cc3fe5e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-e6870d29-7541-4b94-bed3-250cc3fe5e59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:05.421513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:05.422397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:05.423231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 198/395] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:35:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:05.428122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6870d29-7541-4b94-bed3-250cc3fe5e59 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:05.434943 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6bf74-2af3-49df-8ca1-d938463908e8 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:05.525451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3ae70-262f-46ef-bd17-8afc5222ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:05.526247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ae70-262f-46ef-bd17-8afc5222ccee None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:05.526837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ae70-262f-46ef-bd17-8afc5222ccee None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:05.527224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ae70-262f-46ef-bd17-8afc5222ccee None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:05.528493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3ae70-262f-46ef-bd17-8afc5222ccee None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:05.529964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3ae70-262f-46ef-bd17-8afc5222ccee None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:05.535798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 198/396] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:05 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:05.539140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3ae70-262f-46ef-bd17-8afc5222ccee None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:05.554254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6870d29-7541-4b94-bed3-250cc3fe5e59 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:05.587414 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f77bf-99e5-4f28-988a-f872e7770704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:05.588213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f77bf-99e5-4f28-988a-f872e7770704 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:05.588497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f77bf-99e5-4f28-988a-f872e7770704 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:05.588772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f77bf-99e5-4f28-988a-f872e7770704 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:05.589731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f77bf-99e5-4f28-988a-f872e7770704 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:05.590038 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f77bf-99e5-4f28-988a-f872e7770704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:05.591414 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f77bf-99e5-4f28-988a-f872e7770704 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:05.600139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 199/397] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:05.606539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3cd11-0685-4640-853b-00a36dc486c9 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:05.606828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3cd11-0685-4640-853b-00a36dc486c9 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:05.607107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3cd11-0685-4640-853b-00a36dc486c9 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:05.608586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 200/398] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:05.613018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3cd11-0685-4640-853b-00a36dc486c9 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:05.668603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3ae70-262f-46ef-bd17-8afc5222ccee None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:05.706315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b6c42-c3be-4c27-975c-45f63b384e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:05.707504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b6c42-c3be-4c27-975c-45f63b384e2b None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:05.707993 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b6c42-c3be-4c27-975c-45f63b384e2b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:05.708447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b6c42-c3be-4c27-975c-45f63b384e2b None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e/groups/6e303d40d97447e18c6fd9239bd4ca7a/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:05.710719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b6c42-c3be-4c27-975c-45f63b384e2b None admin] RBAC: Authorizing `identity:create_grant(project_id=631886c48e954289908b5e89ccf44d8e, group_id=6e303d40d97447e18c6fd9239bd4ca7a, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:05.712432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b6c42-c3be-4c27-975c-45f63b384e2b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:05.736241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 199/399] 10.222.0.72 () {58 vars in 1442 bytes} [Mon May 16 18:35:05 2022] PUT /identity/v3/projects/631886c48e954289908b5e89ccf44d8e/groups/6e303d40d97447e18c6fd9239bd4ca7a/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:35:05.736241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1edf0b-20f0-4cad-82a9-0cd10d52deb1 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:05.736241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1edf0b-20f0-4cad-82a9-0cd10d52deb1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:05.736241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1edf0b-20f0-4cad-82a9-0cd10d52deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:05.740433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3cd11-0685-4640-853b-00a36dc486c9 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:05.773652 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-1f1edf0b-20f0-4cad-82a9-0cd10d52deb1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:05.775390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1f1edf0b-20f0-4cad-82a9-0cd10d52deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:05.822740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba63f83-84ca-4ec2-9512-7639626784e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:05.824459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba63f83-84ca-4ec2-9512-7639626784e7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:05.824925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba63f83-84ca-4ec2-9512-7639626784e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:05.825378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba63f83-84ca-4ec2-9512-7639626784e7 None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:05.826960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba63f83-84ca-4ec2-9512-7639626784e7 None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:05.830206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba63f83-84ca-4ec2-9512-7639626784e7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:05.835786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 201/400] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:05 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:05.839497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba63f83-84ca-4ec2-9512-7639626784e7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:05.916760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 200/401] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:05.945903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1edf0b-20f0-4cad-82a9-0cd10d52deb1 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:06.018755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba63f83-84ca-4ec2-9512-7639626784e7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:06.056962 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4a76-ee0f-4169-8179-a8c4b31f0e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:06.058324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4a76-ee0f-4169-8179-a8c4b31f0e91 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:06.058880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4a76-ee0f-4169-8179-a8c4b31f0e91 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:06.059391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4a76-ee0f-4169-8179-a8c4b31f0e91 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:06.062132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec4a76-ee0f-4169-8179-a8c4b31f0e91 None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:06.063985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec4a76-ee0f-4169-8179-a8c4b31f0e91 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:06.066380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 202/402] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:05 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:06.073549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4a76-ee0f-4169-8179-a8c4b31f0e91 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:06.097569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1edf0b-20f0-4cad-82a9-0cd10d52deb1 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:06.186401 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552c74e-d233-45d4-acae-491e666dc86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:06.187264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552c74e-d233-45d4-acae-491e666dc86a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:06.187546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552c74e-d233-45d4-acae-491e666dc86a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:06.187843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552c74e-d233-45d4-acae-491e666dc86a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:06.220331 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552c74e-d233-45d4-acae-491e666dc86a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-9552c74e-d233-45d4-acae-491e666dc86a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:06.228872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:06.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:35:06.231255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:06.239767 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4a76-ee0f-4169-8179-a8c4b31f0e91 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:06.240331 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 201/403] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:35:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:06.241446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552c74e-d233-45d4-acae-491e666dc86a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:06.273408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253251c5-a49e-42b8-99ba-46d0ec9900f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:06.274296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253251c5-a49e-42b8-99ba-46d0ec9900f3 None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:06.274578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253251c5-a49e-42b8-99ba-46d0ec9900f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:06.274912 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253251c5-a49e-42b8-99ba-46d0ec9900f3 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e/groups/6e303d40d97447e18c6fd9239bd4ca7a/roles/004dfaca095a4141ae157de95aa6390a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:06.277771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253251c5-a49e-42b8-99ba-46d0ec9900f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=631886c48e954289908b5e89ccf44d8e, group_id=6e303d40d97447e18c6fd9239bd4ca7a, role_id=004dfaca095a4141ae157de95aa6390a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:06.279312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253251c5-a49e-42b8-99ba-46d0ec9900f3 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:06.299534 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 203/404] 10.222.0.72 () {58 vars in 1442 bytes} [Mon May 16 18:35:06 2022] PUT /identity/v3/projects/631886c48e954289908b5e89ccf44d8e/groups/6e303d40d97447e18c6fd9239bd4ca7a/roles/004dfaca095a4141ae157de95aa6390a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:35:06.301694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da537d5-e88a-40a4-a71a-4c69fac32c3c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:06.302145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da537d5-e88a-40a4-a71a-4c69fac32c3c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:06.302548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da537d5-e88a-40a4-a71a-4c69fac32c3c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:06.305110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 204/405] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:06.311506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27f20-6dbc-4d0a-9e25-d4e6313a9de9 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:06.312365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27f20-6dbc-4d0a-9e25-d4e6313a9de9 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:06.312717 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27f20-6dbc-4d0a-9e25-d4e6313a9de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:06.336037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-fcd27f20-6dbc-4d0a-9e25-d4e6313a9de9 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:06.337497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-fcd27f20-6dbc-4d0a-9e25-d4e6313a9de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:06.365595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552c74e-d233-45d4-acae-491e666dc86a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:06.413464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 205/406] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:06.413658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7099dc-baae-4c9d-8ffe-96b92838c33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:06.414265 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7099dc-baae-4c9d-8ffe-96b92838c33b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:06.414647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7099dc-baae-4c9d-8ffe-96b92838c33b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:06.414923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7099dc-baae-4c9d-8ffe-96b92838c33b None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:06.415678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7099dc-baae-4c9d-8ffe-96b92838c33b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:06.416008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7099dc-baae-4c9d-8ffe-96b92838c33b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:06.417945 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7099dc-baae-4c9d-8ffe-96b92838c33b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:06.427704 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 202/407] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:06.434452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd27f20-6dbc-4d0a-9e25-d4e6313a9de9 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:06.447878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7099dc-baae-4c9d-8ffe-96b92838c33b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:06.571998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7099dc-baae-4c9d-8ffe-96b92838c33b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:06.579659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd27f20-6dbc-4d0a-9e25-d4e6313a9de9 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:06.614785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b000-4c07-476f-87cd-5bd6cd89c0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:06.615696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b000-4c07-476f-87cd-5bd6cd89c0b0 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:06.616082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b000-4c07-476f-87cd-5bd6cd89c0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:06.616360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b000-4c07-476f-87cd-5bd6cd89c0b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:06.616531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b47d-8d5e-4a63-b8df-87c4de4d8d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:06.617309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b47d-8d5e-4a63-b8df-87c4de4d8d13 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:06.617588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b47d-8d5e-4a63-b8df-87c4de4d8d13 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:06.617864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b47d-8d5e-4a63-b8df-87c4de4d8d13 None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:06.619533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579b47d-8d5e-4a63-b8df-87c4de4d8d13 None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:06.621096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579b47d-8d5e-4a63-b8df-87c4de4d8d13 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:06.623028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 206/408] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:06 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:06.629156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b47d-8d5e-4a63-b8df-87c4de4d8d13 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:06.635021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3b000-4c07-476f-87cd-5bd6cd89c0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-1aa3b000-4c07-476f-87cd-5bd6cd89c0b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:06.643322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:06.644311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:06.645097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 203/409] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:06.653146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b000-4c07-476f-87cd-5bd6cd89c0b0 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:06.798602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b47d-8d5e-4a63-b8df-87c4de4d8d13 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:06.840212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b000-4c07-476f-87cd-5bd6cd89c0b0 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:06.861300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da63da0-d707-4618-b1fd-d405f1fc13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:06.862176 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da63da0-d707-4618-b1fd-d405f1fc13e7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:06.862462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da63da0-d707-4618-b1fd-d405f1fc13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:06.862738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da63da0-d707-4618-b1fd-d405f1fc13e7 None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:06.864195 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da63da0-d707-4618-b1fd-d405f1fc13e7 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:06.866412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da63da0-d707-4618-b1fd-d405f1fc13e7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:06.868258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 207/410] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:06 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:06.874840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da63da0-d707-4618-b1fd-d405f1fc13e7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:06.895905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b7136-4699-4f4d-a85f-0c8830deff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:06.896581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b7136-4699-4f4d-a85f-0c8830deff06 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:06.896860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b7136-4699-4f4d-a85f-0c8830deff06 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:06.897134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b7136-4699-4f4d-a85f-0c8830deff06 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:06.897889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b7136-4699-4f4d-a85f-0c8830deff06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:06.898193 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b7136-4699-4f4d-a85f-0c8830deff06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:06.899583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b7136-4699-4f4d-a85f-0c8830deff06 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:06.908763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 204/411] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:06.915535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a3e4e-f5df-4f2b-917c-04aaf25180a0 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:06.915869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a3e4e-f5df-4f2b-917c-04aaf25180a0 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:06.916149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a3e4e-f5df-4f2b-917c-04aaf25180a0 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:06.917905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 205/412] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:06.918649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a3e4e-f5df-4f2b-917c-04aaf25180a0 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:07.004080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da63da0-d707-4618-b1fd-d405f1fc13e7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:07.042617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a3e4e-f5df-4f2b-917c-04aaf25180a0 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:07.044487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140d714-dc34-4349-8bf9-bbcc2f1641fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:07.046180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140d714-dc34-4349-8bf9-bbcc2f1641fe None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:07.046469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140d714-dc34-4349-8bf9-bbcc2f1641fe None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:07.046754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140d714-dc34-4349-8bf9-bbcc2f1641fe None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726/groups/6e303d40d97447e18c6fd9239bd4ca7a/roles/004dfaca095a4141ae157de95aa6390a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:07.049028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140d714-dc34-4349-8bf9-bbcc2f1641fe None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0793f1f4e4422f921a1d20504a3726, group_id=6e303d40d97447e18c6fd9239bd4ca7a, role_id=004dfaca095a4141ae157de95aa6390a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:07.050902 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140d714-dc34-4349-8bf9-bbcc2f1641fe None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:07.068345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 208/413] 10.222.0.72 () {58 vars in 1442 bytes} [Mon May 16 18:35:06 2022] PUT /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726/groups/6e303d40d97447e18c6fd9239bd4ca7a/roles/004dfaca095a4141ae157de95aa6390a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:35:07.070443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c1144-3e6b-40e5-839f-315b2c85b7c2 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:07.070794 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c1144-3e6b-40e5-839f-315b2c85b7c2 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:07.071085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c1144-3e6b-40e5-839f-315b2c85b7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:07.077961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f513e4-072f-4c8e-9d75-2c998b009a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:07.079005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f513e4-072f-4c8e-9d75-2c998b009a9c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:07.079379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f513e4-072f-4c8e-9d75-2c998b009a9c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:07.079786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f513e4-072f-4c8e-9d75-2c998b009a9c None admin] PATH_INFO: `/v3/groups/22e32e5ae49d4f49913a8d32ecf6164f` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:07.081256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f513e4-072f-4c8e-9d75-2c998b009a9c None admin] RBAC: Authorizing `identity:get_group(group_id=22e32e5ae49d4f49913a8d32ecf6164f)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:07.082875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f513e4-072f-4c8e-9d75-2c998b009a9c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:07.085030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 206/414] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:06 2022] GET /identity/v3/groups/22e32e5ae49d4f49913a8d32ecf6164f => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:07.090602 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f513e4-072f-4c8e-9d75-2c998b009a9c None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:07.090897 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4d9c1144-3e6b-40e5-839f-315b2c85b7c2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:07.092371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4d9c1144-3e6b-40e5-839f-315b2c85b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:07.176976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 209/415] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:07.206023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f513e4-072f-4c8e-9d75-2c998b009a9c None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:07.219477 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c1144-3e6b-40e5-839f-315b2c85b7c2 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:07.248413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9290ff-ccf3-4fe1-a5bb-9dd4c27dd111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:07.249382 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9290ff-ccf3-4fe1-a5bb-9dd4c27dd111 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:07.249712 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9290ff-ccf3-4fe1-a5bb-9dd4c27dd111 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:07.249985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9290ff-ccf3-4fe1-a5bb-9dd4c27dd111 None admin] PATH_INFO: `/v3/projects/44adac522ccb43149dbafba14f75fd72` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:07.251203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9290ff-ccf3-4fe1-a5bb-9dd4c27dd111 None admin] RBAC: Authorizing `identity:get_project(project_id=44adac522ccb43149dbafba14f75fd72)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:07.259062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9290ff-ccf3-4fe1-a5bb-9dd4c27dd111 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:07.261530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 207/416] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:07 2022] GET /identity/v3/projects/44adac522ccb43149dbafba14f75fd72 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:07.270980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9290ff-ccf3-4fe1-a5bb-9dd4c27dd111 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:07.384476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c1144-3e6b-40e5-839f-315b2c85b7c2 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:07.424045 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9290ff-ccf3-4fe1-a5bb-9dd4c27dd111 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:07.437914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904595a-6ea8-498a-9516-b6ae3ad649ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:07.438646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904595a-6ea8-498a-9516-b6ae3ad649ce None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:07.438978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904595a-6ea8-498a-9516-b6ae3ad649ce None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:07.439202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904595a-6ea8-498a-9516-b6ae3ad649ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:07.473306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904595a-6ea8-498a-9516-b6ae3ad649ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:07.474770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfde281-d247-4698-ae25-366f318ad6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:07.475918 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfde281-d247-4698-ae25-366f318ad6c5 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-3904595a-6ea8-498a-9516-b6ae3ad649ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:07.484362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:07.485271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:35:07.486055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:07.487478 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfde281-d247-4698-ae25-366f318ad6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:07.487989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfde281-d247-4698-ae25-366f318ad6c5 None admin] PATH_INFO: `/v3/projects/44adac522ccb43149dbafba14f75fd72/groups/22e32e5ae49d4f49913a8d32ecf6164f/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:07.490288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfde281-d247-4698-ae25-366f318ad6c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=44adac522ccb43149dbafba14f75fd72, group_id=22e32e5ae49d4f49913a8d32ecf6164f, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:07.491978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfde281-d247-4698-ae25-366f318ad6c5 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:07.498103 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 210/417] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:07.504784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904595a-6ea8-498a-9516-b6ae3ad649ce None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:07.521878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 208/418] 10.222.0.72 () {58 vars in 1442 bytes} [Mon May 16 18:35:07 2022] PUT /identity/v3/projects/44adac522ccb43149dbafba14f75fd72/groups/22e32e5ae49d4f49913a8d32ecf6164f/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:35:07.624351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904595a-6ea8-498a-9516-b6ae3ad649ce None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:07.662845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f857e1a-a0c8-4558-bf9b-50a4c11924e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:07.663535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f857e1a-a0c8-4558-bf9b-50a4c11924e0 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:07.667862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f857e1a-a0c8-4558-bf9b-50a4c11924e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:07.667862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f857e1a-a0c8-4558-bf9b-50a4c11924e0 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:07.667862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f857e1a-a0c8-4558-bf9b-50a4c11924e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:07.667862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f857e1a-a0c8-4558-bf9b-50a4c11924e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:07.667862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f857e1a-a0c8-4558-bf9b-50a4c11924e0 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:07.676505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 211/419] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:35:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:07.682298 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfde281-d247-4698-ae25-366f318ad6c5 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:07.819970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfde281-d247-4698-ae25-366f318ad6c5 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:07.859021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd63a6b-3af6-4f34-ba4e-4ee5dcf86d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:07.859681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd63a6b-3af6-4f34-ba4e-4ee5dcf86d3b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:07.859985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd63a6b-3af6-4f34-ba4e-4ee5dcf86d3b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:07.860263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd63a6b-3af6-4f34-ba4e-4ee5dcf86d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:07.931469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd63a6b-3af6-4f34-ba4e-4ee5dcf86d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:07.933554 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd63a6b-3af6-4f34-ba4e-4ee5dcf86d3b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:08.034226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 209/420] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:08.040806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f857e1a-a0c8-4558-bf9b-50a4c11924e0 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:08.199480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f857e1a-a0c8-4558-bf9b-50a4c11924e0 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:08.235696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977d36b-8582-4eb1-a1c9-acdca2e40568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:08.236930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977d36b-8582-4eb1-a1c9-acdca2e40568 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:08.237401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977d36b-8582-4eb1-a1c9-acdca2e40568 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:08.237869 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977d36b-8582-4eb1-a1c9-acdca2e40568 None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:08.239269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977d36b-8582-4eb1-a1c9-acdca2e40568 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:08.240948 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977d36b-8582-4eb1-a1c9-acdca2e40568 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:08.247813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 212/421] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:08 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:08.249666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd63a6b-3af6-4f34-ba4e-4ee5dcf86d3b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:08.407145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd63a6b-3af6-4f34-ba4e-4ee5dcf86d3b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:08.457048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a08b7d-76e2-4fe3-a484-6e92d0b5544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:08.457844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08b7d-76e2-4fe3-a484-6e92d0b5544f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:08.458126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08b7d-76e2-4fe3-a484-6e92d0b5544f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:08.458403 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08b7d-76e2-4fe3-a484-6e92d0b5544f None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:08.459592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a08b7d-76e2-4fe3-a484-6e92d0b5544f None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:08.461063 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a08b7d-76e2-4fe3-a484-6e92d0b5544f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:08.463111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 210/422] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:08 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:08.470005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977d36b-8582-4eb1-a1c9-acdca2e40568 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:08.558524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7883-6b8c-4e82-816a-87b0a0e258e3 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:08.558853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7883-6b8c-4e82-816a-87b0a0e258e3 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:08.559082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e7883-6b8c-4e82-816a-87b0a0e258e3 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:08.560755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 211/423] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:08.565657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c3fb0-0e33-41fe-ac58-0ce05564aee2 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:08.565915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c3fb0-0e33-41fe-ac58-0ce05564aee2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:08.566194 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c3fb0-0e33-41fe-ac58-0ce05564aee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:08.600892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-317c3fb0-0e33-41fe-ac58-0ce05564aee2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:08.602197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-317c3fb0-0e33-41fe-ac58-0ce05564aee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:08.609618 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977d36b-8582-4eb1-a1c9-acdca2e40568 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:08.645265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c92345-1e9b-4c2b-b3d2-1bd4a2806bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:08.646317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c92345-1e9b-4c2b-b3d2-1bd4a2806bc6 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:08.646809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c92345-1e9b-4c2b-b3d2-1bd4a2806bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:08.647292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c92345-1e9b-4c2b-b3d2-1bd4a2806bc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:08.648383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c92345-1e9b-4c2b-b3d2-1bd4a2806bc6 None admin] RBAC: Adding query filter params (group.id=6e303d40d97447e18c6fd9239bd4ca7a, role.id=627af591fe55445c83abe50f753404c9, scope.project.id=3c0793f1f4e4422f921a1d20504a3726) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:08.648907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c92345-1e9b-4c2b-b3d2-1bd4a2806bc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:08.650548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c92345-1e9b-4c2b-b3d2-1bd4a2806bc6 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:08.663745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 213/424] 10.222.0.72 () {56 vars in 1376 bytes} [Mon May 16 18:35:08 2022] GET /identity/v3/role_assignments?group.id=6e303d40d97447e18c6fd9239bd4ca7a&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=627af591fe55445c83abe50f753404c9 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:08.738272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 212/425] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:08.777738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c92345-1e9b-4c2b-b3d2-1bd4a2806bc6 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:08.909986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c92345-1e9b-4c2b-b3d2-1bd4a2806bc6 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:08.947052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15fdae-b661-4fde-98b4-a09531391eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:08.947893 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15fdae-b661-4fde-98b4-a09531391eae None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:08.948248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15fdae-b661-4fde-98b4-a09531391eae None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:08.948527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15fdae-b661-4fde-98b4-a09531391eae None admin] PATH_INFO: `/v3/roles/member` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:08.958827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284d2d-8695-4281-aa36-4d763526463d None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:08.959341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284d2d-8695-4281-aa36-4d763526463d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:08.959421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284d2d-8695-4281-aa36-4d763526463d None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:08.961020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 213/426] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:08.962129 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15fdae-b661-4fde-98b4-a09531391eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:08.966825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e6da-c21c-473c-81c3-661a72b21d07 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:08.967112 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e6da-c21c-473c-81c3-661a72b21d07 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:08.967392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e6da-c21c-473c-81c3-661a72b21d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-4b15fdae-b661-4fde-98b4-a09531391eae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:08.970683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:08.971556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:08.973022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 214/427] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:08.978016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15fdae-b661-4fde-98b4-a09531391eae None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:08.994684 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-3e77e6da-c21c-473c-81c3-661a72b21d07 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:08.996492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3e77e6da-c21c-473c-81c3-661a72b21d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:09.085196 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 214/428] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:35:09.105479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15fdae-b661-4fde-98b4-a09531391eae None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:09.112043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77e6da-c21c-473c-81c3-661a72b21d07 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:09.151035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4be6b-3848-4a9f-b198-165328b155dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:09.151950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4be6b-3848-4a9f-b198-165328b155dd None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:09.152244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4be6b-3848-4a9f-b198-165328b155dd None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:09.153334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4be6b-3848-4a9f-b198-165328b155dd None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:09.154124 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4be6b-3848-4a9f-b198-165328b155dd None admin] RBAC: Adding query filter params (name=member) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:09.154439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4be6b-3848-4a9f-b198-165328b155dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:09.155857 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4be6b-3848-4a9f-b198-165328b155dd None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:09.166654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 215/429] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:35:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:09.172177 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4be6b-3848-4a9f-b198-165328b155dd None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:09.223106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77e6da-c21c-473c-81c3-661a72b21d07 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:09.259156 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d39cac-1ee1-4f1a-afcb-f7b7ff159c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:09.259924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d39cac-1ee1-4f1a-afcb-f7b7ff159c8d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:09.260208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d39cac-1ee1-4f1a-afcb-f7b7ff159c8d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:09.260483 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d39cac-1ee1-4f1a-afcb-f7b7ff159c8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:09.272081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d39cac-1ee1-4f1a-afcb-f7b7ff159c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:09.279589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4be6b-3848-4a9f-b198-165328b155dd None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-c2d39cac-1ee1-4f1a-afcb-f7b7ff159c8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:09.281877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:09.282817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:35:09.283603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:09.286651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 215/430] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:35:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:09.294789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d39cac-1ee1-4f1a-afcb-f7b7ff159c8d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:09.336013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c62b2f-fac4-4547-b657-d1104d9b3a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:09.336677 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62b2f-fac4-4547-b657-d1104d9b3a29 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:09.336958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62b2f-fac4-4547-b657-d1104d9b3a29 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:09.337233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62b2f-fac4-4547-b657-d1104d9b3a29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:09.428494 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d39cac-1ee1-4f1a-afcb-f7b7ff159c8d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:09.438810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c62b2f-fac4-4547-b657-d1104d9b3a29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:09.441347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c62b2f-fac4-4547-b657-d1104d9b3a29 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:09.467855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15a2a1-b2af-48a7-b7d3-8d91b9e3ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:09.468784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15a2a1-b2af-48a7-b7d3-8d91b9e3ae5e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:09.469065 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15a2a1-b2af-48a7-b7d3-8d91b9e3ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:09.469337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15a2a1-b2af-48a7-b7d3-8d91b9e3ae5e None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:09.470095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15a2a1-b2af-48a7-b7d3-8d91b9e3ae5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:09.470396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15a2a1-b2af-48a7-b7d3-8d91b9e3ae5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:09.471824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15a2a1-b2af-48a7-b7d3-8d91b9e3ae5e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:09.481816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 216/431] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:09.491423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15a2a1-b2af-48a7-b7d3-8d91b9e3ae5e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:09.569564 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 216/432] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:35:09.575867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c62b2f-fac4-4547-b657-d1104d9b3a29 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:09.619422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15a2a1-b2af-48a7-b7d3-8d91b9e3ae5e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:09.663338 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87540671-c163-4796-90e2-70c1106881cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:09.664420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87540671-c163-4796-90e2-70c1106881cb None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:09.664848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87540671-c163-4796-90e2-70c1106881cb None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:09.665588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87540671-c163-4796-90e2-70c1106881cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:09.684347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c62b2f-fac4-4547-b657-d1104d9b3a29 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:09.721838 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b61c-31c2-45e6-b1bc-9c2909720740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:09.722860 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b61c-31c2-45e6-b1bc-9c2909720740 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:09.723240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b61c-31c2-45e6-b1bc-9c2909720740 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:09.723641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b61c-31c2-45e6-b1bc-9c2909720740 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:09.725014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0b61c-31c2-45e6-b1bc-9c2909720740 None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:09.726553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0b61c-31c2-45e6-b1bc-9c2909720740 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:09.728961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 217/433] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:09 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:09.738427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b61c-31c2-45e6-b1bc-9c2909720740 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:09.753917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87540671-c163-4796-90e2-70c1106881cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:09.755366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87540671-c163-4796-90e2-70c1106881cb None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:09.872204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 217/434] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:09.873466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87540671-c163-4796-90e2-70c1106881cb None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:09.874913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b61c-31c2-45e6-b1bc-9c2909720740 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:09.918067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291f876-abff-485e-a68b-362c6fc5af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:09.919750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291f876-abff-485e-a68b-362c6fc5af84 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:09.920185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291f876-abff-485e-a68b-362c6fc5af84 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:09.920608 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291f876-abff-485e-a68b-362c6fc5af84 None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:09.922316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291f876-abff-485e-a68b-362c6fc5af84 None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:09.924594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291f876-abff-485e-a68b-362c6fc5af84 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:09.933708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 218/435] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:09 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:09.934371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291f876-abff-485e-a68b-362c6fc5af84 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:10.000980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87540671-c163-4796-90e2-70c1106881cb None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:10.035424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291f876-abff-485e-a68b-362c6fc5af84 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:10.047037 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d56ce-7b5d-45b6-bdfa-8cbffcba3398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:10.047923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d56ce-7b5d-45b6-bdfa-8cbffcba3398 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.048202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d56ce-7b5d-45b6-bdfa-8cbffcba3398 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.048472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d56ce-7b5d-45b6-bdfa-8cbffcba3398 None admin] PATH_INFO: `/v3/projects/631886c48e954289908b5e89ccf44d8e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.049654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d56ce-7b5d-45b6-bdfa-8cbffcba3398 None admin] RBAC: Authorizing `identity:get_project(project_id=631886c48e954289908b5e89ccf44d8e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:10.051088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d56ce-7b5d-45b6-bdfa-8cbffcba3398 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:10.052946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 218/436] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:09 2022] GET /identity/v3/projects/631886c48e954289908b5e89ccf44d8e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:10.054020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a555-34ec-41c1-a5dc-2bd346ebaf66 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.054325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a555-34ec-41c1-a5dc-2bd346ebaf66 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.054571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a555-34ec-41c1-a5dc-2bd346ebaf66 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.056092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 219/437] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:10.060040 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01a555-34ec-41c1-a5dc-2bd346ebaf66 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:10.077013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be4d83-6f8f-4304-b2fe-2c46d25d122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:10.078066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4d83-6f8f-4304-b2fe-2c46d25d122e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.078852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4d83-6f8f-4304-b2fe-2c46d25d122e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.079278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4d83-6f8f-4304-b2fe-2c46d25d122e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.080303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be4d83-6f8f-4304-b2fe-2c46d25d122e None admin] RBAC: Adding query filter params (group.id=6e303d40d97447e18c6fd9239bd4ca7a, role.id=627af591fe55445c83abe50f753404c9, scope.project.id=631886c48e954289908b5e89ccf44d8e) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:10.080776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be4d83-6f8f-4304-b2fe-2c46d25d122e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:10.083078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be4d83-6f8f-4304-b2fe-2c46d25d122e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:10.092384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 219/438] 10.222.0.72 () {56 vars in 1376 bytes} [Mon May 16 18:35:09 2022] GET /identity/v3/role_assignments?group.id=6e303d40d97447e18c6fd9239bd4ca7a&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=627af591fe55445c83abe50f753404c9 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:10.094019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c1e3d-c3e2-4cb7-92b7-f68dad6a4aa7 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.094443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c1e3d-c3e2-4cb7-92b7-f68dad6a4aa7 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.094849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c1e3d-c3e2-4cb7-92b7-f68dad6a4aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.116615 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-261c1e3d-c3e2-4cb7-92b7-f68dad6a4aa7 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:10.119092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-261c1e3d-c3e2-4cb7-92b7-f68dad6a4aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:10.168828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01a555-34ec-41c1-a5dc-2bd346ebaf66 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:10.207103 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daaa4d-a4c1-4bca-9f00-0178c77b171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:10.208038 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daaa4d-a4c1-4bca-9f00-0178c77b171d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.208313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daaa4d-a4c1-4bca-9f00-0178c77b171d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.208639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daaa4d-a4c1-4bca-9f00-0178c77b171d None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.209965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daaa4d-a4c1-4bca-9f00-0178c77b171d None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:10.211273 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daaa4d-a4c1-4bca-9f00-0178c77b171d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:10.213330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 220/439] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:10 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:10.223739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 220/440] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:10.223960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daaa4d-a4c1-4bca-9f00-0178c77b171d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:10.246281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c1e3d-c3e2-4cb7-92b7-f68dad6a4aa7 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:10.353804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daaa4d-a4c1-4bca-9f00-0178c77b171d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:10.381873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c1e3d-c3e2-4cb7-92b7-f68dad6a4aa7 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:10.389307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69544372-d455-43a7-9c66-d5942a5ab64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:10.389965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69544372-d455-43a7-9c66-d5942a5ab64c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.390246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69544372-d455-43a7-9c66-d5942a5ab64c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.390527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69544372-d455-43a7-9c66-d5942a5ab64c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.391358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69544372-d455-43a7-9c66-d5942a5ab64c None admin] RBAC: Adding query filter params (group.id=6e303d40d97447e18c6fd9239bd4ca7a, role.id=004dfaca095a4141ae157de95aa6390a, scope.project.id=631886c48e954289908b5e89ccf44d8e) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:10.391665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69544372-d455-43a7-9c66-d5942a5ab64c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:10.393266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69544372-d455-43a7-9c66-d5942a5ab64c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:10.399111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 221/441] 10.222.0.72 () {56 vars in 1376 bytes} [Mon May 16 18:35:10 2022] GET /identity/v3/role_assignments?group.id=6e303d40d97447e18c6fd9239bd4ca7a&scope.project.id=631886c48e954289908b5e89ccf44d8e&role.id=004dfaca095a4141ae157de95aa6390a => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:10.418081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16e21-ed90-4614-a05f-29ae2ba40a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:10.418978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16e21-ed90-4614-a05f-29ae2ba40a4d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.419208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16e21-ed90-4614-a05f-29ae2ba40a4d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.419483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16e21-ed90-4614-a05f-29ae2ba40a4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.431364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a16e21-ed90-4614-a05f-29ae2ba40a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-b0a16e21-ed90-4614-a05f-29ae2ba40a4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:10.440354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:10.441418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:10.442202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 221/442] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:35:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:10.447835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69544372-d455-43a7-9c66-d5942a5ab64c None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:10.486577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe3120-4c82-443c-9e8c-560ee3122f8a None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.487122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe3120-4c82-443c-9e8c-560ee3122f8a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.487413 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe3120-4c82-443c-9e8c-560ee3122f8a None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.490112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 222/443] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:10.496753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953c4eb-4a63-474e-a4ca-fbd19c3c9933 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.497043 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953c4eb-4a63-474e-a4ca-fbd19c3c9933 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.497319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953c4eb-4a63-474e-a4ca-fbd19c3c9933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.515015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d953c4eb-4a63-474e-a4ca-fbd19c3c9933 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:10.516263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d953c4eb-4a63-474e-a4ca-fbd19c3c9933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:10.560070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69544372-d455-43a7-9c66-d5942a5ab64c None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:10.587829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 223/444] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:35:10.595626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586c58f-919d-4529-bb6b-7fb892d1dfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:10.596329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586c58f-919d-4529-bb6b-7fb892d1dfcb None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.596612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586c58f-919d-4529-bb6b-7fb892d1dfcb None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.596888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586c58f-919d-4529-bb6b-7fb892d1dfcb None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.597642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586c58f-919d-4529-bb6b-7fb892d1dfcb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:10.597944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586c58f-919d-4529-bb6b-7fb892d1dfcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:10.599292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586c58f-919d-4529-bb6b-7fb892d1dfcb None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:10.608528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 222/445] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:10.610090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953c4eb-4a63-474e-a4ca-fbd19c3c9933 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:10.613887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586c58f-919d-4529-bb6b-7fb892d1dfcb None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:10.712248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953c4eb-4a63-474e-a4ca-fbd19c3c9933 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:10.714996 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586c58f-919d-4529-bb6b-7fb892d1dfcb None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:10.743633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11504f2-caf3-4baf-a6e8-bb681c630b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:10.744455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11504f2-caf3-4baf-a6e8-bb681c630b93 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.744739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11504f2-caf3-4baf-a6e8-bb681c630b93 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.745531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11504f2-caf3-4baf-a6e8-bb681c630b93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.746922 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae330-152d-43f8-a7f1-fcddd577d8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:10.747566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae330-152d-43f8-a7f1-fcddd577d8f9 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.747880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae330-152d-43f8-a7f1-fcddd577d8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.748155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae330-152d-43f8-a7f1-fcddd577d8f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.755215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11504f2-caf3-4baf-a6e8-bb681c630b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-e11504f2-caf3-4baf-a6e8-bb681c630b93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:10.764106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:10.765186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:10.770691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 224/446] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:10.771358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11504f2-caf3-4baf-a6e8-bb681c630b93 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:10.826121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfae330-152d-43f8-a7f1-fcddd577d8f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:10.827606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfae330-152d-43f8-a7f1-fcddd577d8f9 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:10.865033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11504f2-caf3-4baf-a6e8-bb681c630b93 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:10.896747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456a1f3-620c-4e22-9dca-7a055609a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:10.897412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456a1f3-620c-4e22-9dca-7a055609a04e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:10.897695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456a1f3-620c-4e22-9dca-7a055609a04e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:10.897973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456a1f3-620c-4e22-9dca-7a055609a04e None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:10.898723 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456a1f3-620c-4e22-9dca-7a055609a04e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:10.899029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456a1f3-620c-4e22-9dca-7a055609a04e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:10.900556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456a1f3-620c-4e22-9dca-7a055609a04e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:10.908603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 225/447] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:10.914094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456a1f3-620c-4e22-9dca-7a055609a04e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:10.924377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 223/448] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:10.929776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae330-152d-43f8-a7f1-fcddd577d8f9 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:11.009001 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456a1f3-620c-4e22-9dca-7a055609a04e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:11.022811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae330-152d-43f8-a7f1-fcddd577d8f9 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:11.039842 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580746e-2fb9-4215-a3e9-c765f37ec0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:11.040582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580746e-2fb9-4215-a3e9-c765f37ec0e3 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:11.040865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580746e-2fb9-4215-a3e9-c765f37ec0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:11.041145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580746e-2fb9-4215-a3e9-c765f37ec0e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:11.054796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc15269-2558-4d2b-a0fd-51fcfc3a5f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:11.055651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15269-2558-4d2b-a0fd-51fcfc3a5f3c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:11.055966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15269-2558-4d2b-a0fd-51fcfc3a5f3c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:11.056245 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15269-2558-4d2b-a0fd-51fcfc3a5f3c None admin] PATH_INFO: `/v3/projects/3c0793f1f4e4422f921a1d20504a3726` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:11.057534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc15269-2558-4d2b-a0fd-51fcfc3a5f3c None admin] RBAC: Authorizing `identity:get_project(project_id=3c0793f1f4e4422f921a1d20504a3726)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:11.059733 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc15269-2558-4d2b-a0fd-51fcfc3a5f3c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:11.061422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 224/449] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:10 2022] GET /identity/v3/projects/3c0793f1f4e4422f921a1d20504a3726 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:11.066744 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc15269-2558-4d2b-a0fd-51fcfc3a5f3c None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:11.105483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580746e-2fb9-4215-a3e9-c765f37ec0e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:11.106934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580746e-2fb9-4215-a3e9-c765f37ec0e3 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:11.167700 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc15269-2558-4d2b-a0fd-51fcfc3a5f3c None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:11.199452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19967219-6dfd-44be-b0c8-13aa013f4fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:11.203734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 226/450] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 18:35:11.204214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19967219-6dfd-44be-b0c8-13aa013f4fb8 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:11.204214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19967219-6dfd-44be-b0c8-13aa013f4fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:11.204214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19967219-6dfd-44be-b0c8-13aa013f4fb8 None admin] PATH_INFO: `/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:11.204214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19967219-6dfd-44be-b0c8-13aa013f4fb8 None admin] RBAC: Authorizing `identity:get_group(group_id=6e303d40d97447e18c6fd9239bd4ca7a)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:11.204214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19967219-6dfd-44be-b0c8-13aa013f4fb8 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:11.205028 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 225/451] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:11 2022] GET /identity/v3/groups/6e303d40d97447e18c6fd9239bd4ca7a => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:11.205433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580746e-2fb9-4215-a3e9-c765f37ec0e3 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:11.210476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19967219-6dfd-44be-b0c8-13aa013f4fb8 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:11.304405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19967219-6dfd-44be-b0c8-13aa013f4fb8 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:11.306754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580746e-2fb9-4215-a3e9-c765f37ec0e3 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:11.338103 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba246e9a-9a59-449c-9d5b-3efb6b52ce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:11.338824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba246e9a-9a59-449c-9d5b-3efb6b52ce08 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:11.339017 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4dbd-66d6-441d-b858-08fcfe2466f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:11.339140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba246e9a-9a59-449c-9d5b-3efb6b52ce08 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:11.339371 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba246e9a-9a59-449c-9d5b-3efb6b52ce08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:11.339895 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4dbd-66d6-441d-b858-08fcfe2466f7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:11.340173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4dbd-66d6-441d-b858-08fcfe2466f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:11.340262 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba246e9a-9a59-449c-9d5b-3efb6b52ce08 None admin] RBAC: Adding query filter params (group.id=6e303d40d97447e18c6fd9239bd4ca7a, role.id=004dfaca095a4141ae157de95aa6390a, scope.project.id=3c0793f1f4e4422f921a1d20504a3726) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:11.340445 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae4dbd-66d6-441d-b858-08fcfe2466f7 None admin] PATH_INFO: `/v3/projects/44adac522ccb43149dbafba14f75fd72` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:11.340542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba246e9a-9a59-449c-9d5b-3efb6b52ce08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:11.341616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae4dbd-66d6-441d-b858-08fcfe2466f7 None admin] RBAC: Authorizing `identity:get_project(project_id=44adac522ccb43149dbafba14f75fd72)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:11.341952 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba246e9a-9a59-449c-9d5b-3efb6b52ce08 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:11.343021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae4dbd-66d6-441d-b858-08fcfe2466f7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:11.344979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 227/452] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:35:11 2022] GET /identity/v3/projects/44adac522ccb43149dbafba14f75fd72 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:11.362440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 226/453] 10.222.0.72 () {56 vars in 1376 bytes} [Mon May 16 18:35:11 2022] GET /identity/v3/role_assignments?group.id=6e303d40d97447e18c6fd9239bd4ca7a&scope.project.id=3c0793f1f4e4422f921a1d20504a3726&role.id=004dfaca095a4141ae157de95aa6390a => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:11.362659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4dbd-66d6-441d-b858-08fcfe2466f7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:11.452328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae4dbd-66d6-441d-b858-08fcfe2466f7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:11.486465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef35935-4ba9-471d-83bb-a11cd196b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:11.487337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef35935-4ba9-471d-83bb-a11cd196b22c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:11.487619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef35935-4ba9-471d-83bb-a11cd196b22c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:11.487924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef35935-4ba9-471d-83bb-a11cd196b22c None admin] PATH_INFO: `/v3/groups/22e32e5ae49d4f49913a8d32ecf6164f` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:11.489146 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef35935-4ba9-471d-83bb-a11cd196b22c None admin] RBAC: Authorizing `identity:get_group(group_id=22e32e5ae49d4f49913a8d32ecf6164f)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:11.490597 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef35935-4ba9-471d-83bb-a11cd196b22c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:11.492233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 228/454] 10.222.0.72 () {56 vars in 1180 bytes} [Mon May 16 18:35:11 2022] GET /identity/v3/groups/22e32e5ae49d4f49913a8d32ecf6164f => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:11.498647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba246e9a-9a59-449c-9d5b-3efb6b52ce08 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:11.597256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba246e9a-9a59-449c-9d5b-3efb6b52ce08 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:11.630854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7eb82a-c4bb-4e9a-a5ac-d636a8074c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:11.631515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb82a-c4bb-4e9a-a5ac-d636a8074c64 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:11.631829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb82a-c4bb-4e9a-a5ac-d636a8074c64 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:11.632105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7eb82a-c4bb-4e9a-a5ac-d636a8074c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:11.632947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7eb82a-c4bb-4e9a-a5ac-d636a8074c64 None admin] RBAC: Adding query filter params (group.id=22e32e5ae49d4f49913a8d32ecf6164f, role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=44adac522ccb43149dbafba14f75fd72) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:11.633257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7eb82a-c4bb-4e9a-a5ac-d636a8074c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:11.634680 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7eb82a-c4bb-4e9a-a5ac-d636a8074c64 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:11.640688 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 227/455] 10.222.0.72 () {56 vars in 1376 bytes} [Mon May 16 18:35:11 2022] GET /identity/v3/role_assignments?group.id=22e32e5ae49d4f49913a8d32ecf6164f&scope.project.id=44adac522ccb43149dbafba14f75fd72&role.id=b104fd2e772843a0974990f965d8b589 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:14.523526 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30ec8f-6f9f-4b38-af90-2440cd015c78 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:14.524204 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30ec8f-6f9f-4b38-af90-2440cd015c78 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:14.524204 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30ec8f-6f9f-4b38-af90-2440cd015c78 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:14.525918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 229/456] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:14.531410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317673c8-e296-4123-8dff-9a2bc8b87f5d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:14.531925 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317673c8-e296-4123-8dff-9a2bc8b87f5d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:14.532028 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317673c8-e296-4123-8dff-9a2bc8b87f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:14.556815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-317673c8-e296-4123-8dff-9a2bc8b87f5d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:14.558600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-317673c8-e296-4123-8dff-9a2bc8b87f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:14.644186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 228/457] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:14.681600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30ec8f-6f9f-4b38-af90-2440cd015c78 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:14.785900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30ec8f-6f9f-4b38-af90-2440cd015c78 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:14.801341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563478e7-1384-4b5f-b187-e57c3e1fdbf6 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:14.801957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563478e7-1384-4b5f-b187-e57c3e1fdbf6 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:14.802427 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563478e7-1384-4b5f-b187-e57c3e1fdbf6 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:14.805528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 229/458] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:14.810886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a7ad-73da-46c0-a3e0-8ba042fb6f49 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:14.811484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a7ad-73da-46c0-a3e0-8ba042fb6f49 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:14.812021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a7ad-73da-46c0-a3e0-8ba042fb6f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:14.822281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f4ccd-eea1-4d14-b9ce-160e7f78f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:14.823687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4ccd-eea1-4d14-b9ce-160e7f78f199 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:14.824015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4ccd-eea1-4d14-b9ce-160e7f78f199 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:14.824293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4ccd-eea1-4d14-b9ce-160e7f78f199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:14.836062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f4ccd-eea1-4d14-b9ce-160e7f78f199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:14.837675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f4ccd-eea1-4d14-b9ce-160e7f78f199 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-064f4ccd-eea1-4d14-b9ce-160e7f78f199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:14.858075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:14.859116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:14.859986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:14.859986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:14.859986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:14.859986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:14.862082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 230/459] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:14.863369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c0c1a7ad-73da-46c0-a3e0-8ba042fb6f49 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:14.866748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c0c1a7ad-73da-46c0-a3e0-8ba042fb6f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:14.867920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f4ccd-eea1-4d14-b9ce-160e7f78f199 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:14.961497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 230/460] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:35:15.025119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1a7ad-73da-46c0-a3e0-8ba042fb6f49 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:15.045905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f4ccd-eea1-4d14-b9ce-160e7f78f199 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:15.090899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45be95-6fe6-4d5f-b376-4e9f742e5d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:15.091970 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45be95-6fe6-4d5f-b376-4e9f742e5d6c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.092558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45be95-6fe6-4d5f-b376-4e9f742e5d6c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.092976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45be95-6fe6-4d5f-b376-4e9f742e5d6c None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.094643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45be95-6fe6-4d5f-b376-4e9f742e5d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:15.095110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45be95-6fe6-4d5f-b376-4e9f742e5d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:15.097382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45be95-6fe6-4d5f-b376-4e9f742e5d6c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:15.113674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 231/461] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:15.115603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141602e-49fd-4a87-bbb6-eb0246eca0c2 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.116301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141602e-49fd-4a87-bbb6-eb0246eca0c2 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.116749 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141602e-49fd-4a87-bbb6-eb0246eca0c2 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.118757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 232/462] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:15.120450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141602e-49fd-4a87-bbb6-eb0246eca0c2 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:15.141248 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1a7ad-73da-46c0-a3e0-8ba042fb6f49 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:15.189422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d5dc0-a7e4-4abb-a32a-a63f0febdb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:15.190829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d5dc0-a7e4-4abb-a32a-a63f0febdb36 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.191265 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d5dc0-a7e4-4abb-a32a-a63f0febdb36 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.191912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d5dc0-a7e4-4abb-a32a-a63f0febdb36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.207576 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d5dc0-a7e4-4abb-a32a-a63f0febdb36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:15.210192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d5dc0-a7e4-4abb-a32a-a63f0febdb36 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-8c8d5dc0-a7e4-4abb-a32a-a63f0febdb36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:15.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:15.238903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:15.240011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:15.240011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:15.240011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:15.240011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:15.242093 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 231/463] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:15.243444 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710d36-d728-47e5-add8-82a63d07a3a9 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.243890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710d36-d728-47e5-add8-82a63d07a3a9 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.244317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710d36-d728-47e5-add8-82a63d07a3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.248703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141602e-49fd-4a87-bbb6-eb0246eca0c2 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:15.266110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-93710d36-d728-47e5-add8-82a63d07a3a9 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:15.267755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-93710d36-d728-47e5-add8-82a63d07a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:15.293600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981e31-35e8-4ed7-b30c-cf3b971bf8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:15.294892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981e31-35e8-4ed7-b30c-cf3b971bf8e8 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.295533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981e31-35e8-4ed7-b30c-cf3b971bf8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.296413 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d981e31-35e8-4ed7-b30c-cf3b971bf8e8 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.297603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d981e31-35e8-4ed7-b30c-cf3b971bf8e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:15.300033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d981e31-35e8-4ed7-b30c-cf3b971bf8e8 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:15.331693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 233/464] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:35:15 2022] POST /identity/v3/users => generated 246 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:35:15.333719 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981e31-35e8-4ed7-b30c-cf3b971bf8e8 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:15.344337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 232/465] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:15.367812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c41a21-f276-4ba1-aca9-e146db17cb4e None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.368357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c41a21-f276-4ba1-aca9-e146db17cb4e None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.368810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c41a21-f276-4ba1-aca9-e146db17cb4e None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.371383 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 233/466] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:15.376768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773abbc9-57ab-4c08-be5e-af1c3fc42245 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.377324 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773abbc9-57ab-4c08-be5e-af1c3fc42245 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.377781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773abbc9-57ab-4c08-be5e-af1c3fc42245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.400248 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-773abbc9-57ab-4c08-be5e-af1c3fc42245 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:15.402502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-773abbc9-57ab-4c08-be5e-af1c3fc42245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:15.448535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d981e31-35e8-4ed7-b30c-cf3b971bf8e8 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:15.484137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 234/467] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:15.485126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922100d8-c15b-48fd-8dd8-773033c62ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:15.485286 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773abbc9-57ab-4c08-be5e-af1c3fc42245 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:15.485971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922100d8-c15b-48fd-8dd8-773033c62ff5 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.486320 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922100d8-c15b-48fd-8dd8-773033c62ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.486660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922100d8-c15b-48fd-8dd8-773033c62ff5 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.487471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922100d8-c15b-48fd-8dd8-773033c62ff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:15.487882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922100d8-c15b-48fd-8dd8-773033c62ff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:15.489351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922100d8-c15b-48fd-8dd8-773033c62ff5 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:15.502341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 234/468] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:15.508595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922100d8-c15b-48fd-8dd8-773033c62ff5 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:15.615546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922100d8-c15b-48fd-8dd8-773033c62ff5 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:15.619393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773abbc9-57ab-4c08-be5e-af1c3fc42245 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:15.655888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a1250-9322-48bc-8b14-9a8830935dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:15.656632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a1250-9322-48bc-8b14-9a8830935dd7 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.656855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a1250-9322-48bc-8b14-9a8830935dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.657136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a1250-9322-48bc-8b14-9a8830935dd7 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.657760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8ffc1-3691-4778-a713-74e80621f80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:15.657884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a1250-9322-48bc-8b14-9a8830935dd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:15.658555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8ffc1-3691-4778-a713-74e80621f80e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.658834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8ffc1-3691-4778-a713-74e80621f80e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.659104 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8ffc1-3691-4778-a713-74e80621f80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.659290 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a1250-9322-48bc-8b14-9a8830935dd7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:15.669697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8ffc1-3691-4778-a713-74e80621f80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:15.671153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8ffc1-3691-4778-a713-74e80621f80e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:15.685067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 235/469] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:35:15 2022] POST /identity/v3/users => generated 248 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:35:15.685973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a1250-9322-48bc-8b14-9a8830935dd7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-a3e8ffc1-3691-4778-a713-74e80621f80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:15.698450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:15.699482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:15.701435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:15.701435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:15.701435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:15.701435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:15.704132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 235/470] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:15.705824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8ffc1-3691-4778-a713-74e80621f80e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:15.802925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a1250-9322-48bc-8b14-9a8830935dd7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:15.852502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8169f-b4e3-4b5a-8feb-76644f52580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:15.853621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8169f-b4e3-4b5a-8feb-76644f52580d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.853908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8169f-b4e3-4b5a-8feb-76644f52580d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.854422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8169f-b4e3-4b5a-8feb-76644f52580d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.864457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8ffc1-3691-4778-a713-74e80621f80e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:15.870463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8169f-b4e3-4b5a-8feb-76644f52580d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:15.872008 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8169f-b4e3-4b5a-8feb-76644f52580d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-01f8169f-b4e3-4b5a-8feb-76644f52580d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:15.893887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:15.896010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:15.898125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:15.898125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:15.898125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:15.898125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:15.898125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 236/471] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:15.898125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07297e11-48d7-4eb6-9001-a68ab396cf84 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.898125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07297e11-48d7-4eb6-9001-a68ab396cf84 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.898125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07297e11-48d7-4eb6-9001-a68ab396cf84 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.907862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 237/472] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:15.907862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07297e11-48d7-4eb6-9001-a68ab396cf84 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:15.918556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6e2e9-7743-4ed9-8735-b31a053cadfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:15.919769 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e2e9-7743-4ed9-8735-b31a053cadfb None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.920177 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e2e9-7743-4ed9-8735-b31a053cadfb None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.920808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e2e9-7743-4ed9-8735-b31a053cadfb None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.921699 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6e2e9-7743-4ed9-8735-b31a053cadfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:15.922081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6e2e9-7743-4ed9-8735-b31a053cadfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:15.924557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6e2e9-7743-4ed9-8735-b31a053cadfb None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:15.949484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 236/473] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:15.949484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdc2a2-b373-4994-af40-d96cc63c919d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:15.949484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdc2a2-b373-4994-af40-d96cc63c919d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:15.949484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdc2a2-b373-4994-af40-d96cc63c919d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:15.966090 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8fbdc2a2-b373-4994-af40-d96cc63c919d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:15.966963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8fbdc2a2-b373-4994-af40-d96cc63c919d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:16.044530 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07297e11-48d7-4eb6-9001-a68ab396cf84 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:16.052932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 237/474] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:16.053576 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdc2a2-b373-4994-af40-d96cc63c919d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:16.094592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1296b13-1587-4f19-bffe-bd5c3ad4dd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:16.095988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296b13-1587-4f19-bffe-bd5c3ad4dd58 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:16.096787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296b13-1587-4f19-bffe-bd5c3ad4dd58 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:16.097412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296b13-1587-4f19-bffe-bd5c3ad4dd58 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:16.098421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1296b13-1587-4f19-bffe-bd5c3ad4dd58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:16.099062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1296b13-1587-4f19-bffe-bd5c3ad4dd58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:16.101277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1296b13-1587-4f19-bffe-bd5c3ad4dd58 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:16.117224 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 238/475] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:16.118313 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1296b13-1587-4f19-bffe-bd5c3ad4dd58 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:16.164018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdc2a2-b373-4994-af40-d96cc63c919d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:16.206970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca3fe9-ae5e-4c75-af0f-32ade8ef5a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:16.207967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca3fe9-ae5e-4c75-af0f-32ade8ef5a54 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:16.208420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca3fe9-ae5e-4c75-af0f-32ade8ef5a54 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:16.208860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca3fe9-ae5e-4c75-af0f-32ade8ef5a54 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:16.210170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca3fe9-ae5e-4c75-af0f-32ade8ef5a54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:16.212272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca3fe9-ae5e-4c75-af0f-32ade8ef5a54 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:16.222061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1296b13-1587-4f19-bffe-bd5c3ad4dd58 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:16.243977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 238/476] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:35:16 2022] POST /identity/v3/users => generated 248 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:35:16.246163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca3fe9-ae5e-4c75-af0f-32ade8ef5a54 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:16.294312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d277e8-4229-4ae7-abd5-da6414d403ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:16.295046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d277e8-4229-4ae7-abd5-da6414d403ca None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:16.295332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d277e8-4229-4ae7-abd5-da6414d403ca None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:16.295611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d277e8-4229-4ae7-abd5-da6414d403ca None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:16.296406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d277e8-4229-4ae7-abd5-da6414d403ca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:16.297813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d277e8-4229-4ae7-abd5-da6414d403ca None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:16.320222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.sql.core [None req-b4d277e8-4229-4ae7-abd5-da6414d403ca None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 18:35:16.320222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 18:35:16.320222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [parameters: {'id': '4708f4a495d74d0e9ff475a57db591f5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 18:35:16.320222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91825) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-b4d277e8-4229-4ae7-abd5-da6414d403ca None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application conn.query(q) May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result.read() May 16 18:35:16.351360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return ref.to_dict() May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:35:16.352307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application next(self.gen) May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application yield resource May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application next(self.gen) May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.session.rollback() May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.force_reraise() May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise self.value May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application session.commit() May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 18:35:16.353206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._prepare_impl() May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.session.flush() May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._flush(objects) May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application compat.raise_( May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application flush_context.execute() May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rec.execute(self) May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 18:35:16.354896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:35:16.356154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application conn.query(q) May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result.read() May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:35:16.356952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [parameters: {'id': '4708f4a495d74d0e9ff475a57db591f5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:16.357740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 18:35:16.358527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:16.362901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 239/477] 10.222.0.72 () {60 vars in 1131 bytes} [Mon May 16 18:35:16 2022] POST /identity/v3/roles => generated 144 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:16.362901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d277e8-4229-4ae7-abd5-da6414d403ca None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:16.458007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca3fe9-ae5e-4c75-af0f-32ade8ef5a54 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:16.515360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad011523-1ae2-457f-a196-841ff3efcff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:16.516224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011523-1ae2-457f-a196-841ff3efcff5 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:16.516510 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011523-1ae2-457f-a196-841ff3efcff5 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:16.516788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011523-1ae2-457f-a196-841ff3efcff5 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:16.517823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad011523-1ae2-457f-a196-841ff3efcff5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:16.519575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad011523-1ae2-457f-a196-841ff3efcff5 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:16.520405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d277e8-4229-4ae7-abd5-da6414d403ca None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:16.548099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 239/478] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:35:16 2022] POST /identity/v3/users => generated 249 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:35:16.566334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97a610-fc62-4991-bd22-78c5cf5c5a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:16.567168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a610-fc62-4991-bd22-78c5cf5c5a0b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:16.567480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a610-fc62-4991-bd22-78c5cf5c5a0b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:16.567800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a610-fc62-4991-bd22-78c5cf5c5a0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:16.580139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97a610-fc62-4991-bd22-78c5cf5c5a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-1b97a610-fc62-4991-bd22-78c5cf5c5a0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:16.588528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:16.589746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:16.590588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 240/479] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:35:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:16.597884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad011523-1ae2-457f-a196-841ff3efcff5 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:16.707728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad011523-1ae2-457f-a196-841ff3efcff5 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:16.745751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae045d-058f-4bda-b632-32c3134f5e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:16.746361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae045d-058f-4bda-b632-32c3134f5e01 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:16.746641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae045d-058f-4bda-b632-32c3134f5e01 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:16.746913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae045d-058f-4bda-b632-32c3134f5e01 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:16.747677 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae045d-058f-4bda-b632-32c3134f5e01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:16.748011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae045d-058f-4bda-b632-32c3134f5e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:16.749424 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae045d-058f-4bda-b632-32c3134f5e01 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:16.763865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 240/480] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:18.138271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76c94-ff4d-4b56-9e6b-098eef2ce8a3 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:18.138836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76c94-ff4d-4b56-9e6b-098eef2ce8a3 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:18.138836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76c94-ff4d-4b56-9e6b-098eef2ce8a3 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:18.140471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 241/481] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:18.146414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b5308-c22e-414e-bb5b-dd4afb8bc62c None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:18.146868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b5308-c22e-414e-bb5b-dd4afb8bc62c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:18.147051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b5308-c22e-414e-bb5b-dd4afb8bc62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:18.172969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-e11b5308-c22e-414e-bb5b-dd4afb8bc62c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:18.174234 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e11b5308-c22e-414e-bb5b-dd4afb8bc62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:18.275764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 241/482] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:18.311372 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c76c94-ff4d-4b56-9e6b-098eef2ce8a3 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:18.425380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c76c94-ff4d-4b56-9e6b-098eef2ce8a3 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:18.468581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7380e3-4a26-4060-afe4-8be2eb75df74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:18.469380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7380e3-4a26-4060-afe4-8be2eb75df74 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:18.469665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7380e3-4a26-4060-afe4-8be2eb75df74 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:18.470054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7380e3-4a26-4060-afe4-8be2eb75df74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:18.485968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7380e3-4a26-4060-afe4-8be2eb75df74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-5c7380e3-4a26-4060-afe4-8be2eb75df74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:18.494022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:18.496143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:18.496980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 242/483] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:18.501642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b5308-c22e-414e-bb5b-dd4afb8bc62c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:18.541478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1890ea-b3a2-4178-890d-a28a0ef68e21 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:18.542390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1890ea-b3a2-4178-890d-a28a0ef68e21 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:18.542645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1890ea-b3a2-4178-890d-a28a0ef68e21 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:18.544098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 243/484] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:18.565094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d559e0-b1ec-4ae4-bf8f-77312db7e8ce None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:18.565372 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d559e0-b1ec-4ae4-bf8f-77312db7e8ce None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:18.565661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d559e0-b1ec-4ae4-bf8f-77312db7e8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:18.597115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f2d559e0-b1ec-4ae4-bf8f-77312db7e8ce None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:18.597874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f2d559e0-b1ec-4ae4-bf8f-77312db7e8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:18.628586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b5308-c22e-414e-bb5b-dd4afb8bc62c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:18.664537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f72038-dc04-4c7e-9c99-9ec250ad9c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:18.665613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f72038-dc04-4c7e-9c99-9ec250ad9c21 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:18.666263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f72038-dc04-4c7e-9c99-9ec250ad9c21 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:18.667451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f72038-dc04-4c7e-9c99-9ec250ad9c21 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:18.668545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f72038-dc04-4c7e-9c99-9ec250ad9c21 None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:18.669080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f72038-dc04-4c7e-9c99-9ec250ad9c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:18.671171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f72038-dc04-4c7e-9c99-9ec250ad9c21 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:18.683634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 242/485] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:18.688975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f72038-dc04-4c7e-9c99-9ec250ad9c21 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:18.742205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 244/486] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:18.793015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d559e0-b1ec-4ae4-bf8f-77312db7e8ce None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:18.798785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f72038-dc04-4c7e-9c99-9ec250ad9c21 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:18.835101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6caac-bab4-46d6-9d96-f454647b86e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:18.836312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6caac-bab4-46d6-9d96-f454647b86e2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:18.836812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6caac-bab4-46d6-9d96-f454647b86e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:18.837295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6caac-bab4-46d6-9d96-f454647b86e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:18.849462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6caac-bab4-46d6-9d96-f454647b86e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:18.851239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6caac-bab4-46d6-9d96-f454647b86e2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-10f6caac-bab4-46d6-9d96-f454647b86e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:18.869229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:18.871320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:18.872210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:18.872210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:18.872210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:18.872210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:18.874443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 243/487] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:18.880467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6caac-bab4-46d6-9d96-f454647b86e2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:18.994052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d559e0-b1ec-4ae4-bf8f-77312db7e8ce None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:19.044720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6caac-bab4-46d6-9d96-f454647b86e2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:19.053691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83b938-156d-4f45-af7c-b37d506e16f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:19.054555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83b938-156d-4f45-af7c-b37d506e16f5 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.054845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83b938-156d-4f45-af7c-b37d506e16f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.055128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83b938-156d-4f45-af7c-b37d506e16f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.075620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83b938-156d-4f45-af7c-b37d506e16f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-8c83b938-156d-4f45-af7c-b37d506e16f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:19.083531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:19.084451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:19.085267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 245/488] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:19.091768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83b938-156d-4f45-af7c-b37d506e16f5 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:19.096434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d1cca-b0b4-44ee-85be-4ef2574be883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:19.097118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1cca-b0b4-44ee-85be-4ef2574be883 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.097401 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1cca-b0b4-44ee-85be-4ef2574be883 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.097675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1cca-b0b4-44ee-85be-4ef2574be883 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.098407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d1cca-b0b4-44ee-85be-4ef2574be883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:19.098710 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d1cca-b0b4-44ee-85be-4ef2574be883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:19.100106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d1cca-b0b4-44ee-85be-4ef2574be883 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:19.121743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 244/489] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:19.129256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d1cca-b0b4-44ee-85be-4ef2574be883 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:19.208712 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83b938-156d-4f45-af7c-b37d506e16f5 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:19.254346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dcc3b-ab4a-4a68-8129-c7be507d2f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:19.255030 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dcc3b-ab4a-4a68-8129-c7be507d2f82 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.255316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dcc3b-ab4a-4a68-8129-c7be507d2f82 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.255597 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dcc3b-ab4a-4a68-8129-c7be507d2f82 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.256393 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dcc3b-ab4a-4a68-8129-c7be507d2f82 None admin] RBAC: Adding query filter params (name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:19.256702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dcc3b-ab4a-4a68-8129-c7be507d2f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:19.258083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dcc3b-ab4a-4a68-8129-c7be507d2f82 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:19.272568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 246/490] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:19.279679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dcc3b-ab4a-4a68-8129-c7be507d2f82 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:19.326424 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d1cca-b0b4-44ee-85be-4ef2574be883 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:19.384472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8778d-3fc5-413e-8078-710ddc799d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:19.385943 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8778d-3fc5-413e-8078-710ddc799d2f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.387005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8778d-3fc5-413e-8078-710ddc799d2f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.387360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8778d-3fc5-413e-8078-710ddc799d2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.396738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8778d-3fc5-413e-8078-710ddc799d2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:19.398756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8778d-3fc5-413e-8078-710ddc799d2f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-98c8778d-3fc5-413e-8078-710ddc799d2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:19.422047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:19.423009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:19.423944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:19.423944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:19.423944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:19.423944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:19.423944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:19.423944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:19.423944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:19.423944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:19.423944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:19.423944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:19.423944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 245/491] 10.222.0.72 () {56 vars in 1093 bytes} [Mon May 16 18:35:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:19.425502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cde18d-e5d3-4e6a-9e69-dee92e6da536 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.425917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cde18d-e5d3-4e6a-9e69-dee92e6da536 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.426184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dcc3b-ab4a-4a68-8129-c7be507d2f82 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:19.426286 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cde18d-e5d3-4e6a-9e69-dee92e6da536 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.427599 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 246/492] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:19.432922 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cde18d-e5d3-4e6a-9e69-dee92e6da536 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:19.478530 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bde85-86d2-4ba6-be9e-8dbc6eddbe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:19.479809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bde85-86d2-4ba6-be9e-8dbc6eddbe09 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.480299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bde85-86d2-4ba6-be9e-8dbc6eddbe09 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.480792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bde85-86d2-4ba6-be9e-8dbc6eddbe09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.492462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bde85-86d2-4ba6-be9e-8dbc6eddbe09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:19.494237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bde85-86d2-4ba6-be9e-8dbc6eddbe09 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-d43bde85-86d2-4ba6-be9e-8dbc6eddbe09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:19.513362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:19.514265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:19.515097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:19.515097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:19.515097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:19.515097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:19.517329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 247/493] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:19.518829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad5d7-5b8b-4414-a3e7-3997cb808816 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.519316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad5d7-5b8b-4414-a3e7-3997cb808816 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.519810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad5d7-5b8b-4414-a3e7-3997cb808816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.536694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-3a5ad5d7-5b8b-4414-a3e7-3997cb808816 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:19.538212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3a5ad5d7-5b8b-4414-a3e7-3997cb808816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:19.545944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cde18d-e5d3-4e6a-9e69-dee92e6da536 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:19.579848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a5138-af80-4508-99ef-94a7425ad74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:19.580446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a5138-af80-4508-99ef-94a7425ad74c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.580727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a5138-af80-4508-99ef-94a7425ad74c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.580999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a5138-af80-4508-99ef-94a7425ad74c None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.581836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a5138-af80-4508-99ef-94a7425ad74c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:19.582140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a5138-af80-4508-99ef-94a7425ad74c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:19.583559 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a5138-af80-4508-99ef-94a7425ad74c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:19.603463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 248/494] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:19.604451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ad5d7-5b8b-4414-a3e7-3997cb808816 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:19.634217 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 247/495] 10.222.0.72 () {56 vars in 1133 bytes} [Mon May 16 18:35:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:19.636341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea93b-fb71-42f9-b255-cbc1e86aa1db None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.636672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea93b-fb71-42f9-b255-cbc1e86aa1db None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.637015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea93b-fb71-42f9-b255-cbc1e86aa1db None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.638520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 248/496] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:19.639232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ea93b-fb71-42f9-b255-cbc1e86aa1db None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:19.718797 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ad5d7-5b8b-4414-a3e7-3997cb808816 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:19.735391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ea93b-fb71-42f9-b255-cbc1e86aa1db None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:19.750576 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546608f-ee48-48c5-943f-9b87f79fa87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:19.751230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546608f-ee48-48c5-943f-9b87f79fa87b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.751508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546608f-ee48-48c5-943f-9b87f79fa87b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.751813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546608f-ee48-48c5-943f-9b87f79fa87b None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.752533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546608f-ee48-48c5-943f-9b87f79fa87b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:19.752833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546608f-ee48-48c5-943f-9b87f79fa87b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:19.754198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546608f-ee48-48c5-943f-9b87f79fa87b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:19.765317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 249/497] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:19.766101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546608f-ee48-48c5-943f-9b87f79fa87b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:19.768756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0336e7-1ce8-4276-b5e3-14565493d856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:19.769546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0336e7-1ce8-4276-b5e3-14565493d856 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.769821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0336e7-1ce8-4276-b5e3-14565493d856 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.770091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0336e7-1ce8-4276-b5e3-14565493d856 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.780080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0336e7-1ce8-4276-b5e3-14565493d856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-6c0336e7-1ce8-4276-b5e3-14565493d856 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:19.787648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:19.788595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:19.789379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 249/498] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:19.790033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a31b-9cc7-49a1-ab93-0af866be58e0 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.790259 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a31b-9cc7-49a1-ab93-0af866be58e0 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.790516 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a31b-9cc7-49a1-ab93-0af866be58e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.806987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-49e3a31b-9cc7-49a1-ab93-0af866be58e0 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:19.808911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-49e3a31b-9cc7-49a1-ab93-0af866be58e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:19.861432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546608f-ee48-48c5-943f-9b87f79fa87b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:19.883731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 250/499] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:19.883731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f257453-8969-4fed-ac1a-54d4b5240f1b None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.883731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f257453-8969-4fed-ac1a-54d4b5240f1b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.883731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f257453-8969-4fed-ac1a-54d4b5240f1b None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.883731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 251/500] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:19.883731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f257453-8969-4fed-ac1a-54d4b5240f1b None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:19.894448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be88fe1-cea7-40e0-afed-a66461b521f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:19.895072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be88fe1-cea7-40e0-afed-a66461b521f0 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:19.895353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be88fe1-cea7-40e0-afed-a66461b521f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:19.895627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be88fe1-cea7-40e0-afed-a66461b521f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:19.958546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be88fe1-cea7-40e0-afed-a66461b521f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:19.960042 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be88fe1-cea7-40e0-afed-a66461b521f0 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:19.987885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f257453-8969-4fed-ac1a-54d4b5240f1b None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:20.020424 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb878d-8bd8-42b8-a0b8-bf921c398c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:20.021213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb878d-8bd8-42b8-a0b8-bf921c398c0e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.021485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb878d-8bd8-42b8-a0b8-bf921c398c0e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.021755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb878d-8bd8-42b8-a0b8-bf921c398c0e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.029514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb878d-8bd8-42b8-a0b8-bf921c398c0e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:20.030976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb878d-8bd8-42b8-a0b8-bf921c398c0e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-14eb878d-8bd8-42b8-a0b8-bf921c398c0e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:20.045346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:20.046254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:20.047168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:20.047168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:20.047168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:20.047168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:20.047168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:20.047168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:20.047168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:20.047168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:20.047168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:35:20.047168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:20.047168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 252/501] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:20.047784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb878d-8bd8-42b8-a0b8-bf921c398c0e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:20.055482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 250/502] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:20.056780 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057a8e-a5ce-4945-8cc7-8c23b67db6c3 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.057066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057a8e-a5ce-4945-8cc7-8c23b67db6c3 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.057463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057a8e-a5ce-4945-8cc7-8c23b67db6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.073198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f3057a8e-a5ce-4945-8cc7-8c23b67db6c3 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:20.074528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f3057a8e-a5ce-4945-8cc7-8c23b67db6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:20.136333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 251/503] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:20.137143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057a8e-a5ce-4945-8cc7-8c23b67db6c3 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:20.144696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb878d-8bd8-42b8-a0b8-bf921c398c0e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:20.178896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09808d04-8cef-4cfb-9779-107d475cd998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:20.179562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09808d04-8cef-4cfb-9779-107d475cd998 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.179874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09808d04-8cef-4cfb-9779-107d475cd998 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.180145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09808d04-8cef-4cfb-9779-107d475cd998 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.180886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09808d04-8cef-4cfb-9779-107d475cd998 None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:20.181189 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09808d04-8cef-4cfb-9779-107d475cd998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:20.183233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09808d04-8cef-4cfb-9779-107d475cd998 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:20.190852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 253/504] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:20.191621 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09808d04-8cef-4cfb-9779-107d475cd998 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:20.241171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057a8e-a5ce-4945-8cc7-8c23b67db6c3 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:20.272779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77932a17-f73a-4d71-8bda-25d49b95d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:20.273567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932a17-f73a-4d71-8bda-25d49b95d97f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.273848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932a17-f73a-4d71-8bda-25d49b95d97f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.274127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932a17-f73a-4d71-8bda-25d49b95d97f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.282840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09808d04-8cef-4cfb-9779-107d475cd998 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:20.284513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77932a17-f73a-4d71-8bda-25d49b95d97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-77932a17-f73a-4d71-8bda-25d49b95d97f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:20.293013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:20.293933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:20.294709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 252/505] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:20.295353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77932a17-f73a-4d71-8bda-25d49b95d97f None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:20.319892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4535e-f237-4a15-a54c-a4e4e36f60c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:20.320639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4535e-f237-4a15-a54c-a4e4e36f60c5 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.320990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4535e-f237-4a15-a54c-a4e4e36f60c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.321334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4535e-f237-4a15-a54c-a4e4e36f60c5 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.322252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4535e-f237-4a15-a54c-a4e4e36f60c5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:20.322552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4535e-f237-4a15-a54c-a4e4e36f60c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:20.324563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4535e-f237-4a15-a54c-a4e4e36f60c5 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:20.340942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 254/506] 10.222.0.72 () {56 vars in 1137 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:20.341740 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4535e-f237-4a15-a54c-a4e4e36f60c5 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:20.391075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77932a17-f73a-4d71-8bda-25d49b95d97f None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:20.422022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabfe57-021b-4d25-9b48-ba70ff386612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:20.422812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabfe57-021b-4d25-9b48-ba70ff386612 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.423090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabfe57-021b-4d25-9b48-ba70ff386612 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.423364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabfe57-021b-4d25-9b48-ba70ff386612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.433892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabfe57-021b-4d25-9b48-ba70ff386612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:20.434229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4535e-f237-4a15-a54c-a4e4e36f60c5 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:20.435354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabfe57-021b-4d25-9b48-ba70ff386612 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-1dabfe57-021b-4d25-9b48-ba70ff386612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:20.452476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:20.453321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:20.454150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:20.454150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:20.454150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:20.454150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:20.454150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 253/507] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:20.454464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabfe57-021b-4d25-9b48-ba70ff386612 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:20.470507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c3814-9e68-49ec-b295-8ddfcab821df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:20.471294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c3814-9e68-49ec-b295-8ddfcab821df None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.471574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c3814-9e68-49ec-b295-8ddfcab821df None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.471882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c3814-9e68-49ec-b295-8ddfcab821df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.481736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c3814-9e68-49ec-b295-8ddfcab821df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:20.483166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c3814-9e68-49ec-b295-8ddfcab821df None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-190c3814-9e68-49ec-b295-8ddfcab821df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:20.500232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:20.501176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:20.502233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:20.502233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:20.502233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:20.502233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:20.502233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 255/508] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:20.502233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c3814-9e68-49ec-b295-8ddfcab821df None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:20.549894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabfe57-021b-4d25-9b48-ba70ff386612 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:20.581036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989b021-cd18-4842-8678-3de819de142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:20.581812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989b021-cd18-4842-8678-3de819de142b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.582090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989b021-cd18-4842-8678-3de819de142b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.582361 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989b021-cd18-4842-8678-3de819de142b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.592568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989b021-cd18-4842-8678-3de819de142b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:20.594289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989b021-cd18-4842-8678-3de819de142b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:20.594956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c3814-9e68-49ec-b295-8ddfcab821df None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-7989b021-cd18-4842-8678-3de819de142b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:20.611358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:20.612237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:20.613060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:20.613060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:20.613060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:20.613060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:20.613060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 254/509] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:20.613769 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989b021-cd18-4842-8678-3de819de142b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:20.628970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508015f6-e52e-40e6-9832-1967def4b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:20.629632 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508015f6-e52e-40e6-9832-1967def4b207 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.629911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508015f6-e52e-40e6-9832-1967def4b207 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.630180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508015f6-e52e-40e6-9832-1967def4b207 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.630920 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508015f6-e52e-40e6-9832-1967def4b207 None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:20.631223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508015f6-e52e-40e6-9832-1967def4b207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:20.632621 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508015f6-e52e-40e6-9832-1967def4b207 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:20.640431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 256/510] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:20.641248 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508015f6-e52e-40e6-9832-1967def4b207 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:20.717108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989b021-cd18-4842-8678-3de819de142b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:20.734181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508015f6-e52e-40e6-9832-1967def4b207 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:20.749262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562896b5-227f-4d9d-9d3a-da4986019260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:20.749909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562896b5-227f-4d9d-9d3a-da4986019260 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.750190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562896b5-227f-4d9d-9d3a-da4986019260 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.750463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562896b5-227f-4d9d-9d3a-da4986019260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.765512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1ec58-af19-4b04-9fd1-f545f04c31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:20.766159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1ec58-af19-4b04-9fd1-f545f04c31d9 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.766432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1ec58-af19-4b04-9fd1-f545f04c31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.766700 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1ec58-af19-4b04-9fd1-f545f04c31d9 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.767414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1ec58-af19-4b04-9fd1-f545f04c31d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:20.767720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1ec58-af19-4b04-9fd1-f545f04c31d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:20.769098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1ec58-af19-4b04-9fd1-f545f04c31d9 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:20.780322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 257/511] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:20.781096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1ec58-af19-4b04-9fd1-f545f04c31d9 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:20.814475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562896b5-227f-4d9d-9d3a-da4986019260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:20.815957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562896b5-227f-4d9d-9d3a-da4986019260 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:20.873599 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1ec58-af19-4b04-9fd1-f545f04c31d9 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:20.904879 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361d99c-2793-41a0-baf0-40fdbac6e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:20.905460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361d99c-2793-41a0-baf0-40fdbac6e0ba None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:20.905738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361d99c-2793-41a0-baf0-40fdbac6e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:20.906012 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361d99c-2793-41a0-baf0-40fdbac6e0ba None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:20.906724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361d99c-2793-41a0-baf0-40fdbac6e0ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:20.907026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361d99c-2793-41a0-baf0-40fdbac6e0ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:20.907465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 255/512] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:20.908334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562896b5-227f-4d9d-9d3a-da4986019260 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:20.908445 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361d99c-2793-41a0-baf0-40fdbac6e0ba None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:20.919858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 258/513] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:20.920671 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361d99c-2793-41a0-baf0-40fdbac6e0ba None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.005680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562896b5-227f-4d9d-9d3a-da4986019260 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.012240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361d99c-2793-41a0-baf0-40fdbac6e0ba None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.038468 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa7106-362a-4a9c-9c5c-5bae40b7447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.039126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa7106-362a-4a9c-9c5c-5bae40b7447b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.039411 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa7106-362a-4a9c-9c5c-5bae40b7447b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.039691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa7106-362a-4a9c-9c5c-5bae40b7447b None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.040442 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa7106-362a-4a9c-9c5c-5bae40b7447b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:21.040747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa7106-362a-4a9c-9c5c-5bae40b7447b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.042666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa7106-362a-4a9c-9c5c-5bae40b7447b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.044100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809018d8-b729-4c08-99d0-1b7659a73e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.044881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809018d8-b729-4c08-99d0-1b7659a73e00 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.045158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809018d8-b729-4c08-99d0-1b7659a73e00 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.045424 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809018d8-b729-4c08-99d0-1b7659a73e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.053255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 256/514] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:21.054034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa7106-362a-4a9c-9c5c-5bae40b7447b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.060104 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809018d8-b729-4c08-99d0-1b7659a73e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.061538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809018d8-b729-4c08-99d0-1b7659a73e00 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-809018d8-b729-4c08-99d0-1b7659a73e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:21.078353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:21.079397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:21.080490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:21.080490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:21.080490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:21.080490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:21.080490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 259/515] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:21.080490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809018d8-b729-4c08-99d0-1b7659a73e00 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.148109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa7106-362a-4a9c-9c5c-5bae40b7447b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.176498 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809018d8-b729-4c08-99d0-1b7659a73e00 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.178648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00318-ad66-4e20-b76b-422e2c07e447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.179429 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00318-ad66-4e20-b76b-422e2c07e447 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.179729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00318-ad66-4e20-b76b-422e2c07e447 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.180007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00318-ad66-4e20-b76b-422e2c07e447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.186901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef00318-ad66-4e20-b76b-422e2c07e447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.188365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef00318-ad66-4e20-b76b-422e2c07e447 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-2ef00318-ad66-4e20-b76b-422e2c07e447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:21.203142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:21.204034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:21.209643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:21.209643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:21.209643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:21.209643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:21.209643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:21.209643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:21.209643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:21.209643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:21.209643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 257/516] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:21.209643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00318-ad66-4e20-b76b-422e2c07e447 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.210181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14209b-0d9b-48d2-bb2e-2f2e0bc2e0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.210181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14209b-0d9b-48d2-bb2e-2f2e0bc2e0bf None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.210181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14209b-0d9b-48d2-bb2e-2f2e0bc2e0bf None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.210375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14209b-0d9b-48d2-bb2e-2f2e0bc2e0bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.221187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14209b-0d9b-48d2-bb2e-2f2e0bc2e0bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.222624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14209b-0d9b-48d2-bb2e-2f2e0bc2e0bf None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-5e14209b-0d9b-48d2-bb2e-2f2e0bc2e0bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:21.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:21.240033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:21.240858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:21.240858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:21.240858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:21.240858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:21.240858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 260/517] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:21.241125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14209b-0d9b-48d2-bb2e-2f2e0bc2e0bf None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.301504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00318-ad66-4e20-b76b-422e2c07e447 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.335225 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b75f0-1e16-40e2-9721-c94bb7f9a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.335921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b75f0-1e16-40e2-9721-c94bb7f9a5c1 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.336201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b75f0-1e16-40e2-9721-c94bb7f9a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.336301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14209b-0d9b-48d2-bb2e-2f2e0bc2e0bf None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.336472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b75f0-1e16-40e2-9721-c94bb7f9a5c1 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.337169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b75f0-1e16-40e2-9721-c94bb7f9a5c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.338704 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b75f0-1e16-40e2-9721-c94bb7f9a5c1 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.358216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 258/518] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:35:21 2022] POST /identity/v3/users => generated 247 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:35:21.359021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b75f0-1e16-40e2-9721-c94bb7f9a5c1 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.369577 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32235-d4ca-458c-87b7-f10cc418d40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.370981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32235-d4ca-458c-87b7-f10cc418d40b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.371423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32235-d4ca-458c-87b7-f10cc418d40b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.371869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32235-d4ca-458c-87b7-f10cc418d40b None admin] PATH_INFO: `/v3/users/glance` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.382818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce32235-d4ca-458c-87b7-f10cc418d40b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.384368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce32235-d4ca-458c-87b7-f10cc418d40b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-dce32235-d4ca-458c-87b7-f10cc418d40b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:21.400717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:21.401981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:21.402887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:21.402887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:21.402887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:21.402887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:21.402887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:21.402887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:21.402887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:21.402887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:21.402887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 18:35:21.402887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:21.406995 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 261/519] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:21.407781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32235-d4ca-458c-87b7-f10cc418d40b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.470379 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b75f0-1e16-40e2-9721-c94bb7f9a5c1 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.507465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570627b-0ab2-4cd7-bd13-800b588e1c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.508175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570627b-0ab2-4cd7-bd13-800b588e1c36 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.508473 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570627b-0ab2-4cd7-bd13-800b588e1c36 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.508737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570627b-0ab2-4cd7-bd13-800b588e1c36 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.509481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570627b-0ab2-4cd7-bd13-800b588e1c36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:21.509786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570627b-0ab2-4cd7-bd13-800b588e1c36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.511269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570627b-0ab2-4cd7-bd13-800b588e1c36 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.519212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32235-d4ca-458c-87b7-f10cc418d40b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.529180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 259/520] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:21.529180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570627b-0ab2-4cd7-bd13-800b588e1c36 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.560935 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7549eb-74bf-44b8-96d6-5079bbe0dc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.561604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7549eb-74bf-44b8-96d6-5079bbe0dc32 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.561895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7549eb-74bf-44b8-96d6-5079bbe0dc32 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.562361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7549eb-74bf-44b8-96d6-5079bbe0dc32 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.562960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7549eb-74bf-44b8-96d6-5079bbe0dc32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:21.563268 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7549eb-74bf-44b8-96d6-5079bbe0dc32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.564732 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7549eb-74bf-44b8-96d6-5079bbe0dc32 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.584002 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 262/521] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:21.584705 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7549eb-74bf-44b8-96d6-5079bbe0dc32 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.633815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570627b-0ab2-4cd7-bd13-800b588e1c36 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.671586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf3b2a-c600-49e3-bf45-c7300b37889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.672272 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf3b2a-c600-49e3-bf45-c7300b37889e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.672559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf3b2a-c600-49e3-bf45-c7300b37889e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.672828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf3b2a-c600-49e3-bf45-c7300b37889e None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.673551 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf3b2a-c600-49e3-bf45-c7300b37889e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:21.673853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf3b2a-c600-49e3-bf45-c7300b37889e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.675246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf3b2a-c600-49e3-bf45-c7300b37889e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.687467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7549eb-74bf-44b8-96d6-5079bbe0dc32 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.691535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 260/522] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:21.692196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf3b2a-c600-49e3-bf45-c7300b37889e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.722211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b563242-c9ba-431e-9c7b-765051eb4d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.722802 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b563242-c9ba-431e-9c7b-765051eb4d41 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.723082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b563242-c9ba-431e-9c7b-765051eb4d41 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.723364 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b563242-c9ba-431e-9c7b-765051eb4d41 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.724216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b563242-c9ba-431e-9c7b-765051eb4d41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:21.724520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b563242-c9ba-431e-9c7b-765051eb4d41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.725942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b563242-c9ba-431e-9c7b-765051eb4d41 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.743172 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 263/523] 10.222.0.72 () {56 vars in 1137 bytes} [Mon May 16 18:35:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:21.744017 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b563242-c9ba-431e-9c7b-765051eb4d41 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.795790 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf3b2a-c600-49e3-bf45-c7300b37889e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.837217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca35db-5d99-418c-a52e-a4634cdf7335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.838394 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca35db-5d99-418c-a52e-a4634cdf7335 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.838818 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca35db-5d99-418c-a52e-a4634cdf7335 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.839234 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca35db-5d99-418c-a52e-a4634cdf7335 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.845277 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b563242-c9ba-431e-9c7b-765051eb4d41 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:21.847005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca35db-5d99-418c-a52e-a4634cdf7335 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.848492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca35db-5d99-418c-a52e-a4634cdf7335 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-5aca35db-5d99-418c-a52e-a4634cdf7335 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:21.863590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:21.864703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:21.865785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:21.865785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:21.865785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:21.865785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:21.865785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:21.865785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:21.865785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:21.865785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:21.865785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:35:21.865785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:21.868017 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 261/524] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:21.869270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca35db-5d99-418c-a52e-a4634cdf7335 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.882030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdae1bc-c7c6-4dad-9a3b-8da15b8a018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:21.882766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdae1bc-c7c6-4dad-9a3b-8da15b8a018a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:21.883051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdae1bc-c7c6-4dad-9a3b-8da15b8a018a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:21.883327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdae1bc-c7c6-4dad-9a3b-8da15b8a018a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:21.884353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdae1bc-c7c6-4dad-9a3b-8da15b8a018a None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=cc09bfcc0d8c4d20a156b3b08ffafa34) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:21.884668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdae1bc-c7c6-4dad-9a3b-8da15b8a018a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:21.886624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdae1bc-c7c6-4dad-9a3b-8da15b8a018a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:21.900064 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 264/525] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:21 2022] GET /identity/v3/role_assignments?user.id=cc09bfcc0d8c4d20a156b3b08ffafa34&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:21.900064 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdae1bc-c7c6-4dad-9a3b-8da15b8a018a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:21.983385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca35db-5d99-418c-a52e-a4634cdf7335 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:22.020688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f84b17-fee5-4b2b-a8ca-a63238ca7dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:22.021565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f84b17-fee5-4b2b-a8ca-a63238ca7dbc None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:22.022027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f84b17-fee5-4b2b-a8ca-a63238ca7dbc None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:22.022304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f84b17-fee5-4b2b-a8ca-a63238ca7dbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:22.030902 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f84b17-fee5-4b2b-a8ca-a63238ca7dbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:22.032408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f84b17-fee5-4b2b-a8ca-a63238ca7dbc None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:22.037108 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdae1bc-c7c6-4dad-9a3b-8da15b8a018a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-43f84b17-fee5-4b2b-a8ca-a63238ca7dbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:22.051738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:22.052835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:22.053856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:22.053856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:22.053856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:22.053856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:22.053856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:22.053856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:22.053856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:22.053856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:22.053856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 262/526] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:22.055312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f84b17-fee5-4b2b-a8ca-a63238ca7dbc None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:22.080465 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a3220-b331-42f2-aade-52dbc49e0c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:22.081297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3220-b331-42f2-aade-52dbc49e0c11 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:22.081683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3220-b331-42f2-aade-52dbc49e0c11 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:22.082485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3220-b331-42f2-aade-52dbc49e0c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:22.162470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a3220-b331-42f2-aade-52dbc49e0c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:22.164294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a3220-b331-42f2-aade-52dbc49e0c11 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:22.179582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f84b17-fee5-4b2b-a8ca-a63238ca7dbc None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:22.215720 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35eacf-6143-404f-9836-00bcd2533c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:22.216521 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35eacf-6143-404f-9836-00bcd2533c03 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:22.216873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35eacf-6143-404f-9836-00bcd2533c03 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:22.217219 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35eacf-6143-404f-9836-00bcd2533c03 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:22.218374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35eacf-6143-404f-9836-00bcd2533c03 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:22.219105 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35eacf-6143-404f-9836-00bcd2533c03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:22.220297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35eacf-6143-404f-9836-00bcd2533c03 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:22.263432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 263/527] 10.222.0.72 () {56 vars in 1139 bytes} [Mon May 16 18:35:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:22.263432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35eacf-6143-404f-9836-00bcd2533c03 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:22.271514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 265/528] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:22.272688 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a3220-b331-42f2-aade-52dbc49e0c11 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:22.360663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35eacf-6143-404f-9836-00bcd2533c03 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:22.374336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a3220-b331-42f2-aade-52dbc49e0c11 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:22.394267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd686ef-4fcc-439e-84fa-2948924cdabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:22.395048 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd686ef-4fcc-439e-84fa-2948924cdabc None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:22.395180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd686ef-4fcc-439e-84fa-2948924cdabc None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:22.395463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd686ef-4fcc-439e-84fa-2948924cdabc None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:22.396294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd686ef-4fcc-439e-84fa-2948924cdabc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:22.396599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd686ef-4fcc-439e-84fa-2948924cdabc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:22.398035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd686ef-4fcc-439e-84fa-2948924cdabc None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:22.410392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3723411-166f-480e-98cd-109f1729448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:22.411366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723411-166f-480e-98cd-109f1729448a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:22.411875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723411-166f-480e-98cd-109f1729448a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:22.412343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723411-166f-480e-98cd-109f1729448a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:22.421953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 264/529] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:22.422915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd686ef-4fcc-439e-84fa-2948924cdabc None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:22.497529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3723411-166f-480e-98cd-109f1729448a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:22.499836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3723411-166f-480e-98cd-109f1729448a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:22.529421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd686ef-4fcc-439e-84fa-2948924cdabc None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:22.565294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fb067-81a5-449d-846f-00fadb9a93e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:22.566446 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fb067-81a5-449d-846f-00fadb9a93e9 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:22.566958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fb067-81a5-449d-846f-00fadb9a93e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:22.567429 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fb067-81a5-449d-846f-00fadb9a93e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:22.578151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fb067-81a5-449d-846f-00fadb9a93e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:22.579904 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fb067-81a5-449d-846f-00fadb9a93e9 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-367fb067-81a5-449d-846f-00fadb9a93e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:22.597900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:22.598806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:22.599647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:22.599647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:22.599647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:22.599647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:22.607193 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 265/530] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:22.607351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 266/531] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:22.607451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fb067-81a5-449d-846f-00fadb9a93e9 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:22.607525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3723411-166f-480e-98cd-109f1729448a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:22.715778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fb067-81a5-449d-846f-00fadb9a93e9 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:22.732569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3723411-166f-480e-98cd-109f1729448a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:22.750563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad528a-56a3-4a34-9792-aff4655750a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:22.751730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad528a-56a3-4a34-9792-aff4655750a3 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:22.752216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad528a-56a3-4a34-9792-aff4655750a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:22.752730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad528a-56a3-4a34-9792-aff4655750a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:22.753824 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad528a-56a3-4a34-9792-aff4655750a3 None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=eb06ac74276c4238b178a2467013348c) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:22.754340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad528a-56a3-4a34-9792-aff4655750a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:22.756034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad528a-56a3-4a34-9792-aff4655750a3 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:22.762924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 266/532] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:22 2022] GET /identity/v3/role_assignments?user.id=eb06ac74276c4238b178a2467013348c&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:22.764135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad528a-56a3-4a34-9792-aff4655750a3 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:22.768559 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382de09a-8c67-4a67-9d02-7ea06706fdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:22.768960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382de09a-8c67-4a67-9d02-7ea06706fdb3 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:22.769156 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382de09a-8c67-4a67-9d02-7ea06706fdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:22.769436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382de09a-8c67-4a67-9d02-7ea06706fdb3 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:22.770193 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382de09a-8c67-4a67-9d02-7ea06706fdb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:22.770503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382de09a-8c67-4a67-9d02-7ea06706fdb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:22.771976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382de09a-8c67-4a67-9d02-7ea06706fdb3 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:22.794966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 267/533] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:22.809971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382de09a-8c67-4a67-9d02-7ea06706fdb3 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:22.883567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad528a-56a3-4a34-9792-aff4655750a3 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:22.948875 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cca25e-8c05-4623-909c-4b56bb3ac41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:22.950111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cca25e-8c05-4623-909c-4b56bb3ac41b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:22.950604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cca25e-8c05-4623-909c-4b56bb3ac41b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:22.951091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cca25e-8c05-4623-909c-4b56bb3ac41b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:22.973576 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cca25e-8c05-4623-909c-4b56bb3ac41b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:22.975066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cca25e-8c05-4623-909c-4b56bb3ac41b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:22.975427 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382de09a-8c67-4a67-9d02-7ea06706fdb3 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-93cca25e-8c05-4623-909c-4b56bb3ac41b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:22.998507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:22.999401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:23.000337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:23.000337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:23.000337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:23.000337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:23.000337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 267/534] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:23.006137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cca25e-8c05-4623-909c-4b56bb3ac41b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:23.044462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741e795-52f4-4a00-a933-b3e18a6a2fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:23.045338 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741e795-52f4-4a00-a933-b3e18a6a2fa6 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:23.045568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741e795-52f4-4a00-a933-b3e18a6a2fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:23.045843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741e795-52f4-4a00-a933-b3e18a6a2fa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:23.061649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741e795-52f4-4a00-a933-b3e18a6a2fa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:23.064591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741e795-52f4-4a00-a933-b3e18a6a2fa6 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-9741e795-52f4-4a00-a933-b3e18a6a2fa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:23.101396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:23.102337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:23.103167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:23.103167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:23.103167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:23.103167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:23.103167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:23.103167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:23.103167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:23.103167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:23.103167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 268/535] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:23.115765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741e795-52f4-4a00-a933-b3e18a6a2fa6 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:23.132454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cca25e-8c05-4623-909c-4b56bb3ac41b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:23.184485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de235-48d5-4b31-94cf-e962240ebbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:23.185177 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de235-48d5-4b31-94cf-e962240ebbde None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:23.185457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de235-48d5-4b31-94cf-e962240ebbde None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:23.185730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de235-48d5-4b31-94cf-e962240ebbde None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:23.186463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0de235-48d5-4b31-94cf-e962240ebbde None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:23.186766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0de235-48d5-4b31-94cf-e962240ebbde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:23.188170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0de235-48d5-4b31-94cf-e962240ebbde None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:23.204839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 268/536] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:23.210271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de235-48d5-4b31-94cf-e962240ebbde None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:23.246405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741e795-52f4-4a00-a933-b3e18a6a2fa6 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:23.281231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca229d-3ed0-46f6-b55d-c38cf1736506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:23.281902 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca229d-3ed0-46f6-b55d-c38cf1736506 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:23.282188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca229d-3ed0-46f6-b55d-c38cf1736506 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:23.282465 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca229d-3ed0-46f6-b55d-c38cf1736506 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:23.283267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca229d-3ed0-46f6-b55d-c38cf1736506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:23.283577 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca229d-3ed0-46f6-b55d-c38cf1736506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:23.288871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca229d-3ed0-46f6-b55d-c38cf1736506 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:23.315170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 269/537] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:23.324360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca229d-3ed0-46f6-b55d-c38cf1736506 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:23.415408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de235-48d5-4b31-94cf-e962240ebbde None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:23.429294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca229d-3ed0-46f6-b55d-c38cf1736506 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:23.463467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edf814-155b-487b-b202-3c08acc5ae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:23.464170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edf814-155b-487b-b202-3c08acc5ae88 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:23.464451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edf814-155b-487b-b202-3c08acc5ae88 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:23.464723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edf814-155b-487b-b202-3c08acc5ae88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:23.465560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edf814-155b-487b-b202-3c08acc5ae88 None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=6f0e623c10804239a076fc6cde9b198d) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:23.465868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edf814-155b-487b-b202-3c08acc5ae88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:23.467286 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edf814-155b-487b-b202-3c08acc5ae88 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:23.473466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 270/538] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:23 2022] GET /identity/v3/role_assignments?user.id=6f0e623c10804239a076fc6cde9b198d&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:23.496324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d1ce1-1ad4-4c49-8933-e7d3bc630a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:23.497156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d1ce1-1ad4-4c49-8933-e7d3bc630a30 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:23.497441 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d1ce1-1ad4-4c49-8933-e7d3bc630a30 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:23.497720 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d1ce1-1ad4-4c49-8933-e7d3bc630a30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:23.513106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d1ce1-1ad4-4c49-8933-e7d3bc630a30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:23.514621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d1ce1-1ad4-4c49-8933-e7d3bc630a30 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-f27d1ce1-1ad4-4c49-8933-e7d3bc630a30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:23.532977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:23.535058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:23.537194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:23.537194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:23.537194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:23.537194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:23.537194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:23.537194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:23.537194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:23.537194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:23.537194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 269/539] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:23.545514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edf814-155b-487b-b202-3c08acc5ae88 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:23.712951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edf814-155b-487b-b202-3c08acc5ae88 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:23.758026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f08802-bb9c-4337-8e09-46a2a1e7139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:23.759120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08802-bb9c-4337-8e09-46a2a1e7139d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:23.759610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08802-bb9c-4337-8e09-46a2a1e7139d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:23.760685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08802-bb9c-4337-8e09-46a2a1e7139d None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:23.761915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f08802-bb9c-4337-8e09-46a2a1e7139d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:23.762475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f08802-bb9c-4337-8e09-46a2a1e7139d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:23.764273 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f08802-bb9c-4337-8e09-46a2a1e7139d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:23.782217 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 271/540] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:23.788206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d1ce1-1ad4-4c49-8933-e7d3bc630a30 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:23.939339 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda7369-ed76-402e-8f01-279c310426e7 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:23.939934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda7369-ed76-402e-8f01-279c310426e7 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:23.940483 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda7369-ed76-402e-8f01-279c310426e7 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:23.942067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 272/541] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:23.954234 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551ff4-560f-485e-9bd6-38d46d558d3f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:23.954805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551ff4-560f-485e-9bd6-38d46d558d3f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:23.955325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551ff4-560f-485e-9bd6-38d46d558d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:23.963243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d1ce1-1ad4-4c49-8933-e7d3bc630a30 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:23.981831 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-ec551ff4-560f-485e-9bd6-38d46d558d3f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:23.983353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ec551ff4-560f-485e-9bd6-38d46d558d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:24.037315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a71c71-3701-4c87-9442-fca4f8100270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:24.037988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a71c71-3701-4c87-9442-fca4f8100270 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:24.038275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a71c71-3701-4c87-9442-fca4f8100270 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:24.038557 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a71c71-3701-4c87-9442-fca4f8100270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:24.039401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a71c71-3701-4c87-9442-fca4f8100270 None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=c22a0fc8a3914f7fb3356a84827db326) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:24.043425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a71c71-3701-4c87-9442-fca4f8100270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:24.043425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a71c71-3701-4c87-9442-fca4f8100270 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:24.050022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 270/542] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:23 2022] GET /identity/v3/role_assignments?user.id=c22a0fc8a3914f7fb3356a84827db326&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:24.067901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 273/543] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:35:24.099411 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a71c71-3701-4c87-9442-fca4f8100270 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:24.221221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a71c71-3701-4c87-9442-fca4f8100270 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:24.269687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a3faf-fc31-4aed-8b9d-ffee5167b11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:24.270780 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3faf-fc31-4aed-8b9d-ffee5167b11a None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:24.271215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3faf-fc31-4aed-8b9d-ffee5167b11a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:24.271633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3faf-fc31-4aed-8b9d-ffee5167b11a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:24.288839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a3faf-fc31-4aed-8b9d-ffee5167b11a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-924a3faf-fc31-4aed-8b9d-ffee5167b11a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:24.297581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:24.298800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:24.299907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:24.302252 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 271/544] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:24.308632 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec551ff4-560f-485e-9bd6-38d46d558d3f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:24.470882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fa9e5-554f-4e04-9223-23f05b59373c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:24.471993 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fa9e5-554f-4e04-9223-23f05b59373c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:24.472485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fa9e5-554f-4e04-9223-23f05b59373c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:24.474261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 272/545] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:24.479649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc594e-e207-4183-92d2-bc6507700192 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:24.480082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc594e-e207-4183-92d2-bc6507700192 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:24.480367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc594e-e207-4183-92d2-bc6507700192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:24.509086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-94bc594e-e207-4183-92d2-bc6507700192 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:24.510812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-94bc594e-e207-4183-92d2-bc6507700192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:24.527834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec551ff4-560f-485e-9bd6-38d46d558d3f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:24.587368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87699242-7776-463e-838a-7a9445217c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:24.588090 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87699242-7776-463e-838a-7a9445217c5e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:24.588970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87699242-7776-463e-838a-7a9445217c5e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:24.589248 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87699242-7776-463e-838a-7a9445217c5e None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:24.590013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87699242-7776-463e-838a-7a9445217c5e None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:24.590319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87699242-7776-463e-838a-7a9445217c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:24.591698 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87699242-7776-463e-838a-7a9445217c5e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:24.606641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 274/546] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:24.612768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87699242-7776-463e-838a-7a9445217c5e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:24.637958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 273/547] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:35:24.661504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc594e-e207-4183-92d2-bc6507700192 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:24.775214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87699242-7776-463e-838a-7a9445217c5e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:24.796374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc594e-e207-4183-92d2-bc6507700192 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:24.816054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc12533-003e-4836-874a-fe6945dbb46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:24.816852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12533-003e-4836-874a-fe6945dbb46e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:24.817127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12533-003e-4836-874a-fe6945dbb46e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:24.817396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12533-003e-4836-874a-fe6945dbb46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:24.836229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc12533-003e-4836-874a-fe6945dbb46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:24.837696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc12533-003e-4836-874a-fe6945dbb46e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:24.863550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70ea90-4941-4462-8695-bb315b51e1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:24.864368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70ea90-4941-4462-8695-bb315b51e1ed None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:24.864649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70ea90-4941-4462-8695-bb315b51e1ed None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:24.864921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70ea90-4941-4462-8695-bb315b51e1ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-ccc12533-003e-4836-874a-fe6945dbb46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:24.871664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:24.872552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:24.873479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:24.873479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:24.873479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:24.873479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:24.873479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 275/548] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:24.880663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc12533-003e-4836-874a-fe6945dbb46e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:24.882813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70ea90-4941-4462-8695-bb315b51e1ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-0d70ea90-4941-4462-8695-bb315b51e1ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:24.891201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:24.893338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:24.895262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 274/549] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:24.898705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70ea90-4941-4462-8695-bb315b51e1ed None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:25.001593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70ea90-4941-4462-8695-bb315b51e1ed None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:25.044024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e07b48-0980-4087-9d33-4908f2a335e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:25.044627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e07b48-0980-4087-9d33-4908f2a335e3 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:25.044909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e07b48-0980-4087-9d33-4908f2a335e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:25.045189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e07b48-0980-4087-9d33-4908f2a335e3 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:25.045955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e07b48-0980-4087-9d33-4908f2a335e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:25.046262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e07b48-0980-4087-9d33-4908f2a335e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:25.047647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e07b48-0980-4087-9d33-4908f2a335e3 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:25.074901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 275/550] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:25.077158 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e07b48-0980-4087-9d33-4908f2a335e3 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:25.124006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc12533-003e-4836-874a-fe6945dbb46e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:25.172567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e26199-a4c6-449c-84a7-fa3e27aa0e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:25.173262 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26199-a4c6-449c-84a7-fa3e27aa0e11 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:25.173545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26199-a4c6-449c-84a7-fa3e27aa0e11 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:25.173820 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26199-a4c6-449c-84a7-fa3e27aa0e11 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:25.174571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e26199-a4c6-449c-84a7-fa3e27aa0e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:25.174878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e26199-a4c6-449c-84a7-fa3e27aa0e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:25.176342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e26199-a4c6-449c-84a7-fa3e27aa0e11 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:25.204252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 276/551] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:25.205263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e26199-a4c6-449c-84a7-fa3e27aa0e11 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:25.228771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e07b48-0980-4087-9d33-4908f2a335e3 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:25.265028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733d698-b9f3-445a-9cdc-7743d9527529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:25.265994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d698-b9f3-445a-9cdc-7743d9527529 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:25.266286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d698-b9f3-445a-9cdc-7743d9527529 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:25.266563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d698-b9f3-445a-9cdc-7743d9527529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:25.293482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733d698-b9f3-445a-9cdc-7743d9527529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:25.295454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733d698-b9f3-445a-9cdc-7743d9527529 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-5733d698-b9f3-445a-9cdc-7743d9527529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:25.334269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:25.335233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:25.336152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:25.336152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:25.336152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:25.336152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:25.341071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 276/552] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:25.346743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733d698-b9f3-445a-9cdc-7743d9527529 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:25.394547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e26199-a4c6-449c-84a7-fa3e27aa0e11 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:25.435525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db96b7-2742-478a-b72f-98213f734e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:25.436397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db96b7-2742-478a-b72f-98213f734e76 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:25.436683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db96b7-2742-478a-b72f-98213f734e76 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:25.436959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db96b7-2742-478a-b72f-98213f734e76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:25.444830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db96b7-2742-478a-b72f-98213f734e76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:25.446281 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db96b7-2742-478a-b72f-98213f734e76 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-f7db96b7-2742-478a-b72f-98213f734e76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:25.461991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:25.462964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:25.463946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:25.463946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:25.463946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:25.463946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:25.463946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:25.463946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:25.463946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:25.463946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:25.463946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:25.463946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:25.463946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 277/553] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:25.465035 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4f057-ee68-4580-840f-d92cbbaf7c14 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:25.465754 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4f057-ee68-4580-840f-d92cbbaf7c14 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:25.465754 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4f057-ee68-4580-840f-d92cbbaf7c14 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:25.467143 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 278/554] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:25.474665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba9dae-40aa-4f3f-8ccf-076def06a823 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:25.474665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba9dae-40aa-4f3f-8ccf-076def06a823 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:25.474665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba9dae-40aa-4f3f-8ccf-076def06a823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:25.486230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733d698-b9f3-445a-9cdc-7743d9527529 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:25.493444 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c8ba9dae-40aa-4f3f-8ccf-076def06a823 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:25.495673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c8ba9dae-40aa-4f3f-8ccf-076def06a823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:25.524322 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53d0e-bd12-4bc0-b301-abeda8538fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:25.525353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53d0e-bd12-4bc0-b301-abeda8538fcc None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:25.525951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53d0e-bd12-4bc0-b301-abeda8538fcc None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:25.526444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53d0e-bd12-4bc0-b301-abeda8538fcc None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:25.527392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b53d0e-bd12-4bc0-b301-abeda8538fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:25.527956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b53d0e-bd12-4bc0-b301-abeda8538fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:25.529774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b53d0e-bd12-4bc0-b301-abeda8538fcc None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:25.543404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 277/555] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:25.544972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53d0e-bd12-4bc0-b301-abeda8538fcc None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:25.565366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 279/556] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:35:25.566213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba9dae-40aa-4f3f-8ccf-076def06a823 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:25.647504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53d0e-bd12-4bc0-b301-abeda8538fcc None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:25.665523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba9dae-40aa-4f3f-8ccf-076def06a823 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:25.684746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b029f-d110-4bc1-8dc3-1190862b9810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:25.685816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b029f-d110-4bc1-8dc3-1190862b9810 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:25.686322 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b029f-d110-4bc1-8dc3-1190862b9810 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:25.686852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b029f-d110-4bc1-8dc3-1190862b9810 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:25.687942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b029f-d110-4bc1-8dc3-1190862b9810 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:25.688519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b029f-d110-4bc1-8dc3-1190862b9810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:25.690169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b029f-d110-4bc1-8dc3-1190862b9810 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:25.700257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54e657-0864-402b-bd06-6d0a69c3226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:25.701782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e657-0864-402b-bd06-6d0a69c3226b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:25.701782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e657-0864-402b-bd06-6d0a69c3226b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:25.701782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e657-0864-402b-bd06-6d0a69c3226b None admin] PATH_INFO: `/v3/users/nova` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:25.709135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54e657-0864-402b-bd06-6d0a69c3226b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:25.710583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54e657-0864-402b-bd06-6d0a69c3226b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:25.711542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 278/557] 10.222.0.72 () {56 vars in 1135 bytes} [Mon May 16 18:35:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:25.712610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b029f-d110-4bc1-8dc3-1190862b9810 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-4e54e657-0864-402b-bd06-6d0a69c3226b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:25.725819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:25.726779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 280/558] 10.222.0.72 () {56 vars in 1093 bytes} [Mon May 16 18:35:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:25.728205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54e657-0864-402b-bd06-6d0a69c3226b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:25.817472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b029f-d110-4bc1-8dc3-1190862b9810 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:25.830091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54e657-0864-402b-bd06-6d0a69c3226b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:25.853809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63649bd-45ac-4c3c-b88a-e208f3c894eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:25.855100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63649bd-45ac-4c3c-b88a-e208f3c894eb None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:25.855610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63649bd-45ac-4c3c-b88a-e208f3c894eb None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:25.856136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63649bd-45ac-4c3c-b88a-e208f3c894eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:25.865608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8704b-e1d7-40e2-b436-f11db8773eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:25.866261 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8704b-e1d7-40e2-b436-f11db8773eb5 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:25.866543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8704b-e1d7-40e2-b436-f11db8773eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:25.866822 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8704b-e1d7-40e2-b436-f11db8773eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:25.868254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63649bd-45ac-4c3c-b88a-e208f3c894eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-d63649bd-45ac-4c3c-b88a-e208f3c894eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:25.876778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:25.877686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:25.878528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:25.881267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 279/559] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:25.882363 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63649bd-45ac-4c3c-b88a-e208f3c894eb None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:25.935839 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8704b-e1d7-40e2-b436-f11db8773eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:25.937324 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8704b-e1d7-40e2-b436-f11db8773eb5 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:25.998271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63649bd-45ac-4c3c-b88a-e208f3c894eb None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:26.035404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59234e-8e50-4f68-87c8-b9f3bf327bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:26.036536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59234e-8e50-4f68-87c8-b9f3bf327bb0 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.037085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59234e-8e50-4f68-87c8-b9f3bf327bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.037580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59234e-8e50-4f68-87c8-b9f3bf327bb0 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.038684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59234e-8e50-4f68-87c8-b9f3bf327bb0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:26.039230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59234e-8e50-4f68-87c8-b9f3bf327bb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:26.040990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 281/560] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:26.041252 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59234e-8e50-4f68-87c8-b9f3bf327bb0 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:26.042596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8704b-e1d7-40e2-b436-f11db8773eb5 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:26.065469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 280/561] 10.222.0.72 () {56 vars in 1133 bytes} [Mon May 16 18:35:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:26.066649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59234e-8e50-4f68-87c8-b9f3bf327bb0 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:26.145074 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8704b-e1d7-40e2-b436-f11db8773eb5 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:26.169663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59234e-8e50-4f68-87c8-b9f3bf327bb0 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:26.179550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de6834-9ce9-4a55-9426-9804bffa36b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:26.180492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de6834-9ce9-4a55-9426-9804bffa36b5 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.180606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de6834-9ce9-4a55-9426-9804bffa36b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.180796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de6834-9ce9-4a55-9426-9804bffa36b5 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.181531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de6834-9ce9-4a55-9426-9804bffa36b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:26.181832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de6834-9ce9-4a55-9426-9804bffa36b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:26.183804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de6834-9ce9-4a55-9426-9804bffa36b5 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:26.192379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 282/562] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:26.193281 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de6834-9ce9-4a55-9426-9804bffa36b5 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:26.209032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb512c-5942-45ac-b69f-1327d3a85a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:26.210231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb512c-5942-45ac-b69f-1327d3a85a73 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.210729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb512c-5942-45ac-b69f-1327d3a85a73 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.211223 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb512c-5942-45ac-b69f-1327d3a85a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.225604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb512c-5942-45ac-b69f-1327d3a85a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:26.228028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb512c-5942-45ac-b69f-1327d3a85a73 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-99cb512c-5942-45ac-b69f-1327d3a85a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:26.249707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:26.250668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:26.252247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:26.252247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:26.252247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:26.252247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:26.252247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 281/563] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:26.252247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb512c-5942-45ac-b69f-1327d3a85a73 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:26.305992 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de6834-9ce9-4a55-9426-9804bffa36b5 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:26.342514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48ab24-a612-46d8-b5aa-72846726a29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:26.343562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48ab24-a612-46d8-b5aa-72846726a29b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.343873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48ab24-a612-46d8-b5aa-72846726a29b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.344147 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48ab24-a612-46d8-b5aa-72846726a29b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.353500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb512c-5942-45ac-b69f-1327d3a85a73 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:26.355777 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48ab24-a612-46d8-b5aa-72846726a29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:26.357285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48ab24-a612-46d8-b5aa-72846726a29b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-4b48ab24-a612-46d8-b5aa-72846726a29b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:26.375367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:26.376377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:26.377450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:26.377450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:26.377450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:26.377450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:26.380228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 283/564] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:26.382123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780c3d6-6b51-48b4-a144-12a7401cd05c None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.382414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780c3d6-6b51-48b4-a144-12a7401cd05c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.382717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780c3d6-6b51-48b4-a144-12a7401cd05c None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.384304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 284/565] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:26.384943 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780c3d6-6b51-48b4-a144-12a7401cd05c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:26.398002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb907-c187-4225-b8fd-2fafd5a6f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:26.398746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb907-c187-4225-b8fd-2fafd5a6f239 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.399029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb907-c187-4225-b8fd-2fafd5a6f239 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.399306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb907-c187-4225-b8fd-2fafd5a6f239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.410537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fb907-c187-4225-b8fd-2fafd5a6f239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:26.412031 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fb907-c187-4225-b8fd-2fafd5a6f239 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-b99fb907-c187-4225-b8fd-2fafd5a6f239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:26.429135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:26.430063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:26.430929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:26.430929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:26.430929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:26.430929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:26.430929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 282/566] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:26.431538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb907-c187-4225-b8fd-2fafd5a6f239 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:26.499291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780c3d6-6b51-48b4-a144-12a7401cd05c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:26.528763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb907-c187-4225-b8fd-2fafd5a6f239 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:26.532593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b05fbf-8e92-4827-9593-28e3f8dda8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:26.533252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05fbf-8e92-4827-9593-28e3f8dda8b2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.533529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05fbf-8e92-4827-9593-28e3f8dda8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.533795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05fbf-8e92-4827-9593-28e3f8dda8b2 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.534511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b05fbf-8e92-4827-9593-28e3f8dda8b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:26.534817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b05fbf-8e92-4827-9593-28e3f8dda8b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:26.536204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b05fbf-8e92-4827-9593-28e3f8dda8b2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:26.549128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 285/567] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:26.550379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4d0d-2b2d-458a-b861-aaa23dfccb89 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.550662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4d0d-2b2d-458a-b861-aaa23dfccb89 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.550931 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4d0d-2b2d-458a-b861-aaa23dfccb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.567078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170d323-c960-4268-b3b3-18d25dd6b61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:26.567771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170d323-c960-4268-b3b3-18d25dd6b61d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.568058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170d323-c960-4268-b3b3-18d25dd6b61d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.568334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170d323-c960-4268-b3b3-18d25dd6b61d None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.568767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8a1b4d0d-2b2d-458a-b861-aaa23dfccb89 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:26.569201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170d323-c960-4268-b3b3-18d25dd6b61d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:26.569349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170d323-c960-4268-b3b3-18d25dd6b61d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:26.569943 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8a1b4d0d-2b2d-458a-b861-aaa23dfccb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:26.570716 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170d323-c960-4268-b3b3-18d25dd6b61d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:26.582200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 283/568] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:26.582988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170d323-c960-4268-b3b3-18d25dd6b61d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:26.632810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 286/569] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:26.633645 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b4d0d-2b2d-458a-b861-aaa23dfccb89 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:26.687640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170d323-c960-4268-b3b3-18d25dd6b61d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:26.720255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dd207-c001-4802-b6aa-b77e0ecaec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:26.720920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dd207-c001-4802-b6aa-b77e0ecaec86 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.721205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dd207-c001-4802-b6aa-b77e0ecaec86 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.721483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dd207-c001-4802-b6aa-b77e0ecaec86 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.722203 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dd207-c001-4802-b6aa-b77e0ecaec86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:26.722505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dd207-c001-4802-b6aa-b77e0ecaec86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:26.723911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dd207-c001-4802-b6aa-b77e0ecaec86 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:26.729408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b4d0d-2b2d-458a-b861-aaa23dfccb89 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:26.734963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 284/570] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:26.736303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c611a-bd00-4127-9798-e6a37fe10bda None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.736594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c611a-bd00-4127-9798-e6a37fe10bda None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.736870 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c611a-bd00-4127-9798-e6a37fe10bda None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.741822 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 285/571] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:26.741822 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c611a-bd00-4127-9798-e6a37fe10bda None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:26.765243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ca852-78ca-43bd-81f7-79235ac52dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:26.766029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ca852-78ca-43bd-81f7-79235ac52dc1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.766304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ca852-78ca-43bd-81f7-79235ac52dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.766573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ca852-78ca-43bd-81f7-79235ac52dc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.772962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ca852-78ca-43bd-81f7-79235ac52dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:26.774366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ca852-78ca-43bd-81f7-79235ac52dc1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-962ca852-78ca-43bd-81f7-79235ac52dc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:26.787998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:26.788978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:26.790775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:26.790775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:26.790775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:26.790775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:26.790775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:26.790775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:26.790775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:26.790775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:26.790775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 287/572] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:26.790775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ca852-78ca-43bd-81f7-79235ac52dc1 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:26.835681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c611a-bd00-4127-9798-e6a37fe10bda None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:26.868148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1882dc-2a44-4987-92a5-a144712e5bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:26.868953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1882dc-2a44-4987-92a5-a144712e5bf7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.869214 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1882dc-2a44-4987-92a5-a144712e5bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.869525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1882dc-2a44-4987-92a5-a144712e5bf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.876008 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1882dc-2a44-4987-92a5-a144712e5bf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:26.877448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1882dc-2a44-4987-92a5-a144712e5bf7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:26.886731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ca852-78ca-43bd-81f7-79235ac52dc1 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-9f1882dc-2a44-4987-92a5-a144712e5bf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:26.891351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:26.892402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:26.893469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:26.893469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:26.893469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:26.893469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:26.893469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:26.893469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:26.893469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:26.893469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:26.893469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 286/573] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:26.893469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1882dc-2a44-4987-92a5-a144712e5bf7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:26.922978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1232616-0748-4c82-a178-7569992f4c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:26.923798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232616-0748-4c82-a178-7569992f4c2b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.924078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232616-0748-4c82-a178-7569992f4c2b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.924351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232616-0748-4c82-a178-7569992f4c2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.935368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1232616-0748-4c82-a178-7569992f4c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-c1232616-0748-4c82-a178-7569992f4c2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:26.943092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:26.944105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:26.944926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 288/574] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:26.945607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede0dae-7fa1-49d0-a426-ea0396c7e243 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:26.945677 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede0dae-7fa1-49d0-a426-ea0396c7e243 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:26.946182 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede0dae-7fa1-49d0-a426-ea0396c7e243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:26.962260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-9ede0dae-7fa1-49d0-a426-ea0396c7e243 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:26.963477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9ede0dae-7fa1-49d0-a426-ea0396c7e243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:26.993477 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1882dc-2a44-4987-92a5-a144712e5bf7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.026118 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e87f-3e44-4411-b461-47e883316956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.026911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e87f-3e44-4411-b461-47e883316956 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.027195 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e87f-3e44-4411-b461-47e883316956 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.027473 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e87f-3e44-4411-b461-47e883316956 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:27.027738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 289/575] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:27.028656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede0dae-7fa1-49d0-a426-ea0396c7e243 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.034689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991e87f-3e44-4411-b461-47e883316956 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:27.036186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991e87f-3e44-4411-b461-47e883316956 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-e991e87f-3e44-4411-b461-47e883316956 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:27.051050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:27.052192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 287/576] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:27.053646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e87f-3e44-4411-b461-47e883316956 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.129390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede0dae-7fa1-49d0-a426-ea0396c7e243 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.147319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e87f-3e44-4411-b461-47e883316956 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.161538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7626-f2a8-4816-8e2a-a1096d0d5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.162197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7626-f2a8-4816-8e2a-a1096d0d5de7 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.162479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7626-f2a8-4816-8e2a-a1096d0d5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.162754 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7626-f2a8-4816-8e2a-a1096d0d5de7 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:27.163548 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff7626-f2a8-4816-8e2a-a1096d0d5de7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:27.163899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff7626-f2a8-4816-8e2a-a1096d0d5de7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:27.165316 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff7626-f2a8-4816-8e2a-a1096d0d5de7 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:27.176509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 290/577] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:27.177290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7626-f2a8-4816-8e2a-a1096d0d5de7 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.183520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cb404-5ace-4f56-a0d8-a19566f2dfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.184207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cb404-5ace-4f56-a0d8-a19566f2dfd1 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.184489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cb404-5ace-4f56-a0d8-a19566f2dfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.184766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cb404-5ace-4f56-a0d8-a19566f2dfd1 None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:27.185555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cb404-5ace-4f56-a0d8-a19566f2dfd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:27.185864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cb404-5ace-4f56-a0d8-a19566f2dfd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:27.187338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cb404-5ace-4f56-a0d8-a19566f2dfd1 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:27.198798 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 288/578] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:27.199370 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cb404-5ace-4f56-a0d8-a19566f2dfd1 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.276482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7626-f2a8-4816-8e2a-a1096d0d5de7 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.292866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cb404-5ace-4f56-a0d8-a19566f2dfd1 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.309517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd1bbd-ab1f-40f2-bd0d-2a00df0a8d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.310185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd1bbd-ab1f-40f2-bd0d-2a00df0a8d48 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.310468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd1bbd-ab1f-40f2-bd0d-2a00df0a8d48 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.310745 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd1bbd-ab1f-40f2-bd0d-2a00df0a8d48 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:27.311493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd1bbd-ab1f-40f2-bd0d-2a00df0a8d48 None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:27.311839 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd1bbd-ab1f-40f2-bd0d-2a00df0a8d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:27.313207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd1bbd-ab1f-40f2-bd0d-2a00df0a8d48 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:27.320788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 291/579] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:27.321556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd1bbd-ab1f-40f2-bd0d-2a00df0a8d48 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.326611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cc64f-7260-41ef-a56d-03cf31b7add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.327406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc64f-7260-41ef-a56d-03cf31b7add6 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.327691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc64f-7260-41ef-a56d-03cf31b7add6 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.327996 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc64f-7260-41ef-a56d-03cf31b7add6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:27.338011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cc64f-7260-41ef-a56d-03cf31b7add6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-479cc64f-7260-41ef-a56d-03cf31b7add6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:27.346092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:27.347221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 289/580] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:27.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cc64f-7260-41ef-a56d-03cf31b7add6 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.418013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd1bbd-ab1f-40f2-bd0d-2a00df0a8d48 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.441541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cc64f-7260-41ef-a56d-03cf31b7add6 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.449678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6242ab-e69a-411d-a3c9-ca88053836f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.450282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6242ab-e69a-411d-a3c9-ca88053836f7 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.450561 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6242ab-e69a-411d-a3c9-ca88053836f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.450832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6242ab-e69a-411d-a3c9-ca88053836f7 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:27.451669 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6242ab-e69a-411d-a3c9-ca88053836f7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:27.452007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6242ab-e69a-411d-a3c9-ca88053836f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:27.453440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6242ab-e69a-411d-a3c9-ca88053836f7 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:27.470861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 292/581] 10.222.0.72 () {56 vars in 1137 bytes} [Mon May 16 18:35:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:27.471629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6242ab-e69a-411d-a3c9-ca88053836f7 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.474450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5ac3-554d-4263-a62f-2ccd63deeea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5ac3-554d-4263-a62f-2ccd63deeea6 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.475437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5ac3-554d-4263-a62f-2ccd63deeea6 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.475736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5ac3-554d-4263-a62f-2ccd63deeea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:27.476667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e5ac3-554d-4263-a62f-2ccd63deeea6 None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=55231d7b40cb4479b9a6580a0f0b7cb0) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:27.476978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e5ac3-554d-4263-a62f-2ccd63deeea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:27.478406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e5ac3-554d-4263-a62f-2ccd63deeea6 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:27.484066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 290/582] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:27 2022] GET /identity/v3/role_assignments?user.id=55231d7b40cb4479b9a6580a0f0b7cb0&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:27.484840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5ac3-554d-4263-a62f-2ccd63deeea6 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.575045 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6242ab-e69a-411d-a3c9-ca88053836f7 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.589301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5ac3-554d-4263-a62f-2ccd63deeea6 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.611154 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbd431-1ab5-4303-a5e3-30583fb15899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.612117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbd431-1ab5-4303-a5e3-30583fb15899 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.612400 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbd431-1ab5-4303-a5e3-30583fb15899 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.612676 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbd431-1ab5-4303-a5e3-30583fb15899 None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/cc09bfcc0d8c4d20a156b3b08ffafa34/roles/07ebf23e49074f6ca9b1f96878f4fa7b` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:27.624529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dba26-a963-4d52-b211-1721ccc19b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.625758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dba26-a963-4d52-b211-1721ccc19b21 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.626108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dba26-a963-4d52-b211-1721ccc19b21 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.626453 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dba26-a963-4d52-b211-1721ccc19b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:27.628472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbd431-1ab5-4303-a5e3-30583fb15899 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=cc09bfcc0d8c4d20a156b3b08ffafa34, role_id=07ebf23e49074f6ca9b1f96878f4fa7b)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:27.629950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbd431-1ab5-4303-a5e3-30583fb15899 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:27.640034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dba26-a963-4d52-b211-1721ccc19b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:27.641516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dba26-a963-4d52-b211-1721ccc19b21 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:27.655739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 293/583] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:35:27 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/cc09bfcc0d8c4d20a156b3b08ffafa34/roles/07ebf23e49074f6ca9b1f96878f4fa7b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:35:27.655739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbd431-1ab5-4303-a5e3-30583fb15899 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-690dba26-a963-4d52-b211-1721ccc19b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:27.661032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:27.662172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:27.663275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:27.663275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:27.663275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:27.663275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:27.667556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 291/584] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:27.668639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dba26-a963-4d52-b211-1721ccc19b21 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.783537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbd431-1ab5-4303-a5e3-30583fb15899 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.823253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da05ea-9fa5-4cc2-880c-0140e5d1c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.824984 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da05ea-9fa5-4cc2-880c-0140e5d1c8be None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.825712 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da05ea-9fa5-4cc2-880c-0140e5d1c8be None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.826212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da05ea-9fa5-4cc2-880c-0140e5d1c8be None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:27.827186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da05ea-9fa5-4cc2-880c-0140e5d1c8be None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:27.827509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dba26-a963-4d52-b211-1721ccc19b21 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.827903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da05ea-9fa5-4cc2-880c-0140e5d1c8be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:27.829707 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da05ea-9fa5-4cc2-880c-0140e5d1c8be None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:27.842375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 294/585] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:27.843819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da05ea-9fa5-4cc2-880c-0140e5d1c8be None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.880081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ac695-2c7e-4636-bd52-5168c77a53a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.881043 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ac695-2c7e-4636-bd52-5168c77a53a0 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.881335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ac695-2c7e-4636-bd52-5168c77a53a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.881612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ac695-2c7e-4636-bd52-5168c77a53a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:27.895279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ac695-2c7e-4636-bd52-5168c77a53a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:27.897238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ac695-2c7e-4636-bd52-5168c77a53a0 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-4f4ac695-2c7e-4636-bd52-5168c77a53a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:27.924154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:27.925107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:27.925991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:27.925991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:27.925991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:27.925991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:27.925991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 292/586] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:27.926702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ac695-2c7e-4636-bd52-5168c77a53a0 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:27.962623 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da05ea-9fa5-4cc2-880c-0140e5d1c8be None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:27.998206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f8ec4-8c82-475d-b68c-90887ee8cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:27.998871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8ec4-8c82-475d-b68c-90887ee8cbc9 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:27.999148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8ec4-8c82-475d-b68c-90887ee8cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:27.999416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8ec4-8c82-475d-b68c-90887ee8cbc9 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.000170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f8ec4-8c82-475d-b68c-90887ee8cbc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:28.000469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f8ec4-8c82-475d-b68c-90887ee8cbc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.001821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f8ec4-8c82-475d-b68c-90887ee8cbc9 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.014287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 295/587] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:28.015207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f8ec4-8c82-475d-b68c-90887ee8cbc9 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:28.039845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ac695-2c7e-4636-bd52-5168c77a53a0 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.074152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fad3bc-2ac0-42b5-988d-d1dd082ac27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:28.074933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fad3bc-2ac0-42b5-988d-d1dd082ac27b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:28.075217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fad3bc-2ac0-42b5-988d-d1dd082ac27b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:28.075493 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fad3bc-2ac0-42b5-988d-d1dd082ac27b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.086424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fad3bc-2ac0-42b5-988d-d1dd082ac27b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.087925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fad3bc-2ac0-42b5-988d-d1dd082ac27b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-c9fad3bc-2ac0-42b5-988d-d1dd082ac27b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:28.107248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:28.109337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:28.111331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:28.111331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:28.111331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:28.111331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:28.111331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 293/588] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:28.111331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fad3bc-2ac0-42b5-988d-d1dd082ac27b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:28.121071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f8ec4-8c82-475d-b68c-90887ee8cbc9 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.156009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637a17f-3ccc-4257-bc84-b7ff2ab3a35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:28.156673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a17f-3ccc-4257-bc84-b7ff2ab3a35a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:28.156952 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a17f-3ccc-4257-bc84-b7ff2ab3a35a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:28.157201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a17f-3ccc-4257-bc84-b7ff2ab3a35a None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.157927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637a17f-3ccc-4257-bc84-b7ff2ab3a35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:28.158226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637a17f-3ccc-4257-bc84-b7ff2ab3a35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.159584 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637a17f-3ccc-4257-bc84-b7ff2ab3a35a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.171960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 296/589] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:28.172779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637a17f-3ccc-4257-bc84-b7ff2ab3a35a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:28.211846 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fad3bc-2ac0-42b5-988d-d1dd082ac27b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.245912 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be26e-05f5-40ec-b4ee-eec7d3093a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:28.246809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be26e-05f5-40ec-b4ee-eec7d3093a4a None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:28.247167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be26e-05f5-40ec-b4ee-eec7d3093a4a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:28.247512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be26e-05f5-40ec-b4ee-eec7d3093a4a None admin] PATH_INFO: `/v3/users/glance` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.255334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0be26e-05f5-40ec-b4ee-eec7d3093a4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.256888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0be26e-05f5-40ec-b4ee-eec7d3093a4a None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-dd0be26e-05f5-40ec-b4ee-eec7d3093a4a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:28.272263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:28.274368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:28.275502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:28.275502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:28.275502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:28.275502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:28.275502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:28.275502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:28.275502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:28.275502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:28.275502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 18:35:28.275502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:28.276816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 294/590] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:28.281105 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be26e-05f5-40ec-b4ee-eec7d3093a4a None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:28.281241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637a17f-3ccc-4257-bc84-b7ff2ab3a35a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.314398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9321d1c-f8af-4e01-9de3-36d8cf10f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:28.315033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321d1c-f8af-4e01-9de3-36d8cf10f87f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:28.315316 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321d1c-f8af-4e01-9de3-36d8cf10f87f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:28.315584 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9321d1c-f8af-4e01-9de3-36d8cf10f87f None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.316403 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9321d1c-f8af-4e01-9de3-36d8cf10f87f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:28.316702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9321d1c-f8af-4e01-9de3-36d8cf10f87f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.318051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9321d1c-f8af-4e01-9de3-36d8cf10f87f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.335106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 297/591] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:28.336024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9321d1c-f8af-4e01-9de3-36d8cf10f87f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:28.379040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be26e-05f5-40ec-b4ee-eec7d3093a4a None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.413879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba37b0-31f6-4279-a515-c990a3cac4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:28.414912 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba37b0-31f6-4279-a515-c990a3cac4e9 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:28.415298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba37b0-31f6-4279-a515-c990a3cac4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:28.415674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba37b0-31f6-4279-a515-c990a3cac4e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.422937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba37b0-31f6-4279-a515-c990a3cac4e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.424571 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba37b0-31f6-4279-a515-c990a3cac4e9 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.435466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9321d1c-f8af-4e01-9de3-36d8cf10f87f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-c2ba37b0-31f6-4279-a515-c990a3cac4e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:28.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:28.441075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:28.442169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:28.442169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:28.442169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:28.442169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:28.442169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:28.442169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:28.442169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:28.442169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:28.443757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 295/592] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:28.444704 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba37b0-31f6-4279-a515-c990a3cac4e9 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:28.474990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552d4d9-f24e-421d-a99b-327c3e126ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:28.475658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552d4d9-f24e-421d-a99b-327c3e126ef7 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:28.475964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552d4d9-f24e-421d-a99b-327c3e126ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:28.476233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552d4d9-f24e-421d-a99b-327c3e126ef7 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.477066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552d4d9-f24e-421d-a99b-327c3e126ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:28.477369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552d4d9-f24e-421d-a99b-327c3e126ef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.478844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552d4d9-f24e-421d-a99b-327c3e126ef7 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.497172 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 298/593] 10.222.0.72 () {56 vars in 1137 bytes} [Mon May 16 18:35:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:28.498056 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552d4d9-f24e-421d-a99b-327c3e126ef7 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:28.548535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba37b0-31f6-4279-a515-c990a3cac4e9 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.582113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7a5ca-ff21-44f8-a937-2fcb2c2a43b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:28.583033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7a5ca-ff21-44f8-a937-2fcb2c2a43b3 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:28.583442 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7a5ca-ff21-44f8-a937-2fcb2c2a43b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:28.583850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7a5ca-ff21-44f8-a937-2fcb2c2a43b3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.591675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7a5ca-ff21-44f8-a937-2fcb2c2a43b3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.593515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7a5ca-ff21-44f8-a937-2fcb2c2a43b3 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.595379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552d4d9-f24e-421d-a99b-327c3e126ef7 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-dbf7a5ca-ff21-44f8-a937-2fcb2c2a43b3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:28.609344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:28.610484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:28.611638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:28.611638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:28.611638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:28.611638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:28.611638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:28.611638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:28.611638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:28.611638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:28.611638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:35:28.611638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:28.615978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 296/594] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:28.615978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7a5ca-ff21-44f8-a937-2fcb2c2a43b3 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:28.634006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5065a-bff9-4441-bc34-c2fbd96824c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:28.634668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5065a-bff9-4441-bc34-c2fbd96824c2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:28.634977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5065a-bff9-4441-bc34-c2fbd96824c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:28.635810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5065a-bff9-4441-bc34-c2fbd96824c2 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.636604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5065a-bff9-4441-bc34-c2fbd96824c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:28.636907 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5065a-bff9-4441-bc34-c2fbd96824c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.638327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5065a-bff9-4441-bc34-c2fbd96824c2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.654548 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 299/595] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:28.655405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5065a-bff9-4441-bc34-c2fbd96824c2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:28.720233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7a5ca-ff21-44f8-a937-2fcb2c2a43b3 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.759203 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab4658-e372-4d1b-8bd7-f27afe440db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:28.760892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab4658-e372-4d1b-8bd7-f27afe440db7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:28.761332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab4658-e372-4d1b-8bd7-f27afe440db7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:28.761798 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab4658-e372-4d1b-8bd7-f27afe440db7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.772783 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab4658-e372-4d1b-8bd7-f27afe440db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.774378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab4658-e372-4d1b-8bd7-f27afe440db7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.776921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5065a-bff9-4441-bc34-c2fbd96824c2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-93ab4658-e372-4d1b-8bd7-f27afe440db7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:28.793601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:28.794714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:28.795850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:28.795850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:28.795850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:28.795850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:28.801472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 297/596] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:28.801472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab4658-e372-4d1b-8bd7-f27afe440db7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:28.816526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225e006-49bb-438c-8015-eae4e5f7fc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:28.817682 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e006-49bb-438c-8015-eae4e5f7fc69 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:28.818243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e006-49bb-438c-8015-eae4e5f7fc69 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:28.818523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e006-49bb-438c-8015-eae4e5f7fc69 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.819574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225e006-49bb-438c-8015-eae4e5f7fc69 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:28.819912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225e006-49bb-438c-8015-eae4e5f7fc69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.821795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225e006-49bb-438c-8015-eae4e5f7fc69 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.848299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 300/597] 10.222.0.72 () {56 vars in 1139 bytes} [Mon May 16 18:35:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:28.849399 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225e006-49bb-438c-8015-eae4e5f7fc69 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:28.908620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab4658-e372-4d1b-8bd7-f27afe440db7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.943731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b56799-22b8-4e4f-939a-c83bc4d2a3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:28.944626 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b56799-22b8-4e4f-939a-c83bc4d2a3d2 None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:28.944905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b56799-22b8-4e4f-939a-c83bc4d2a3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:28.945230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b56799-22b8-4e4f-939a-c83bc4d2a3d2 None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/eb06ac74276c4238b178a2467013348c/roles/07ebf23e49074f6ca9b1f96878f4fa7b` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:28.959951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b56799-22b8-4e4f-939a-c83bc4d2a3d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=eb06ac74276c4238b178a2467013348c, role_id=07ebf23e49074f6ca9b1f96878f4fa7b)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:28.961399 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b56799-22b8-4e4f-939a-c83bc4d2a3d2 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:28.972186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225e006-49bb-438c-8015-eae4e5f7fc69 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:28.977680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 298/598] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:35:28 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/eb06ac74276c4238b178a2467013348c/roles/07ebf23e49074f6ca9b1f96878f4fa7b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:35:28.978593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b56799-22b8-4e4f-939a-c83bc4d2a3d2 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:29.012379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a98e0-e40b-4509-9b0e-800707632940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:29.013513 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a98e0-e40b-4509-9b0e-800707632940 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:29.013998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a98e0-e40b-4509-9b0e-800707632940 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:29.014471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a98e0-e40b-4509-9b0e-800707632940 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:29.015494 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a98e0-e40b-4509-9b0e-800707632940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:29.016035 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a98e0-e40b-4509-9b0e-800707632940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:29.017640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a98e0-e40b-4509-9b0e-800707632940 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:29.030697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 301/599] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:29.036143 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a98e0-e40b-4509-9b0e-800707632940 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:29.111991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b56799-22b8-4e4f-939a-c83bc4d2a3d2 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:29.148556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a98e0-e40b-4509-9b0e-800707632940 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:29.158167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ea887-151e-4eea-b7db-9fe745d32407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:29.158987 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea887-151e-4eea-b7db-9fe745d32407 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:29.159263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea887-151e-4eea-b7db-9fe745d32407 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:29.159541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea887-151e-4eea-b7db-9fe745d32407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:29.172876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ea887-151e-4eea-b7db-9fe745d32407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:29.174832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ea887-151e-4eea-b7db-9fe745d32407 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-496ea887-151e-4eea-b7db-9fe745d32407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:29.195963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:29.196939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:29.199073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:29.199073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:29.199073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:29.199073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:29.199073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 299/600] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:29.205829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ea887-151e-4eea-b7db-9fe745d32407 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:29.232611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92030bf-7c7f-4ee1-a565-f5805dd32a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:29.233889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92030bf-7c7f-4ee1-a565-f5805dd32a71 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:29.234403 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92030bf-7c7f-4ee1-a565-f5805dd32a71 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:29.234884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92030bf-7c7f-4ee1-a565-f5805dd32a71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:29.247268 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92030bf-7c7f-4ee1-a565-f5805dd32a71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:29.249107 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92030bf-7c7f-4ee1-a565-f5805dd32a71 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-f92030bf-7c7f-4ee1-a565-f5805dd32a71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:29.270770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:29.271702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:29.277638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:29.277638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:29.277638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:29.277638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:29.277638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:29.277638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:29.277638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:29.277638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:29.279860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 302/601] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:29.285161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92030bf-7c7f-4ee1-a565-f5805dd32a71 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:29.326530 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ea887-151e-4eea-b7db-9fe745d32407 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:29.369948 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506eb71-cf98-4be8-b3c3-54c564a079f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:29.370674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506eb71-cf98-4be8-b3c3-54c564a079f8 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:29.370957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506eb71-cf98-4be8-b3c3-54c564a079f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:29.371232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506eb71-cf98-4be8-b3c3-54c564a079f8 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:29.372903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506eb71-cf98-4be8-b3c3-54c564a079f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:29.373212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506eb71-cf98-4be8-b3c3-54c564a079f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:29.375294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506eb71-cf98-4be8-b3c3-54c564a079f8 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:29.405366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 300/602] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:29.409701 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506eb71-cf98-4be8-b3c3-54c564a079f8 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:29.458847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92030bf-7c7f-4ee1-a565-f5805dd32a71 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:29.527969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990af4e-7174-4671-a4a9-c9b1c6d951e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:29.528700 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990af4e-7174-4671-a4a9-c9b1c6d951e6 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:29.528973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990af4e-7174-4671-a4a9-c9b1c6d951e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:29.529250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990af4e-7174-4671-a4a9-c9b1c6d951e6 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:29.530044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990af4e-7174-4671-a4a9-c9b1c6d951e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:29.530348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990af4e-7174-4671-a4a9-c9b1c6d951e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:29.531854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990af4e-7174-4671-a4a9-c9b1c6d951e6 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:29.557330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 303/603] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:29.564216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990af4e-7174-4671-a4a9-c9b1c6d951e6 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:29.581516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506eb71-cf98-4be8-b3c3-54c564a079f8 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:29.615496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68455a20-9cc2-40cd-9f41-706d3fd7bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:29.616392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68455a20-9cc2-40cd-9f41-706d3fd7bc38 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:29.616673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68455a20-9cc2-40cd-9f41-706d3fd7bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:29.616947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68455a20-9cc2-40cd-9f41-706d3fd7bc38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:29.625894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68455a20-9cc2-40cd-9f41-706d3fd7bc38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:29.625894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68455a20-9cc2-40cd-9f41-706d3fd7bc38 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-68455a20-9cc2-40cd-9f41-706d3fd7bc38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:29.640415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:29.641570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:29.642612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:29.642612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:29.642612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:29.642612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:29.642612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:29.642612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:29.642612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:29.642612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:29.645505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 301/604] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:29.657788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68455a20-9cc2-40cd-9f41-706d3fd7bc38 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:29.763505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68455a20-9cc2-40cd-9f41-706d3fd7bc38 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:29.783490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990af4e-7174-4671-a4a9-c9b1c6d951e6 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:29.799089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726453d-7def-4ab2-8a4e-d2f8b57ec291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:29.799981 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726453d-7def-4ab2-8a4e-d2f8b57ec291 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:29.800364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726453d-7def-4ab2-8a4e-d2f8b57ec291 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:29.800736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726453d-7def-4ab2-8a4e-d2f8b57ec291 None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:29.801640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726453d-7def-4ab2-8a4e-d2f8b57ec291 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:29.802042 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726453d-7def-4ab2-8a4e-d2f8b57ec291 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:29.803572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726453d-7def-4ab2-8a4e-d2f8b57ec291 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:29.817037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 302/605] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:29.823080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726453d-7def-4ab2-8a4e-d2f8b57ec291 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:29.849345 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dc7a2-6e3d-4519-a7b9-55a73e4a4a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:29.850252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc7a2-6e3d-4519-a7b9-55a73e4a4a53 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:29.850531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc7a2-6e3d-4519-a7b9-55a73e4a4a53 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:29.850807 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc7a2-6e3d-4519-a7b9-55a73e4a4a53 None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/6f0e623c10804239a076fc6cde9b198d/roles/07ebf23e49074f6ca9b1f96878f4fa7b` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:29.877341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dc7a2-6e3d-4519-a7b9-55a73e4a4a53 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=6f0e623c10804239a076fc6cde9b198d, role_id=07ebf23e49074f6ca9b1f96878f4fa7b)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:29.878717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dc7a2-6e3d-4519-a7b9-55a73e4a4a53 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:29.896365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 304/606] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:35:29 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/6f0e623c10804239a076fc6cde9b198d/roles/07ebf23e49074f6ca9b1f96878f4fa7b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:35:29.947163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174905d-d36c-49b6-b023-3ca111e35ae2 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:29.947657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174905d-d36c-49b6-b023-3ca111e35ae2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:29.948274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174905d-d36c-49b6-b023-3ca111e35ae2 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:29.950429 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 305/607] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:29.957455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9895d8-5327-4f1f-a73f-74d0515bbd0c None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:29.957861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9895d8-5327-4f1f-a73f-74d0515bbd0c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:29.958406 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9895d8-5327-4f1f-a73f-74d0515bbd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:29.980867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-cf9895d8-5327-4f1f-a73f-74d0515bbd0c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:29.982264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-cf9895d8-5327-4f1f-a73f-74d0515bbd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:30.003970 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726453d-7def-4ab2-8a4e-d2f8b57ec291 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:30.069322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 306/608] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:35:30.097404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9895d8-5327-4f1f-a73f-74d0515bbd0c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:30.101557 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beefe1-f0c7-4dd3-b07c-e8599826a5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:30.102661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beefe1-f0c7-4dd3-b07c-e8599826a5d1 None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:30.103098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beefe1-f0c7-4dd3-b07c-e8599826a5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:30.103546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beefe1-f0c7-4dd3-b07c-e8599826a5d1 None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/c22a0fc8a3914f7fb3356a84827db326/roles/07ebf23e49074f6ca9b1f96878f4fa7b` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:30.136333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beefe1-f0c7-4dd3-b07c-e8599826a5d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=c22a0fc8a3914f7fb3356a84827db326, role_id=07ebf23e49074f6ca9b1f96878f4fa7b)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:30.138612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beefe1-f0c7-4dd3-b07c-e8599826a5d1 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:30.170332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 303/609] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:35:29 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/c22a0fc8a3914f7fb3356a84827db326/roles/07ebf23e49074f6ca9b1f96878f4fa7b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:35:30.196373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3140-f93e-4333-9325-9f92911e0e3d None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:30.197071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3140-f93e-4333-9325-9f92911e0e3d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:30.198130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3140-f93e-4333-9325-9f92911e0e3d None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:30.200356 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 304/610] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:30.207741 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7423-8aec-4d0e-851b-ed3f145b650e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:30.207741 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7423-8aec-4d0e-851b-ed3f145b650e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:30.207741 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7423-8aec-4d0e-851b-ed3f145b650e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:30.220249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9895d8-5327-4f1f-a73f-74d0515bbd0c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:30.228332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b4ef7423-8aec-4d0e-851b-ed3f145b650e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:30.229798 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b4ef7423-8aec-4d0e-851b-ed3f145b650e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:30.262754 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd95633-38db-4d45-a325-5f0db83a2071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:30.263582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd95633-38db-4d45-a325-5f0db83a2071 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:30.263898 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd95633-38db-4d45-a325-5f0db83a2071 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:30.264175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd95633-38db-4d45-a325-5f0db83a2071 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:30.277886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd95633-38db-4d45-a325-5f0db83a2071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-4fd95633-38db-4d45-a325-5f0db83a2071 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:30.286741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:30.287748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:30.288631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 307/611] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:30.300544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd95633-38db-4d45-a325-5f0db83a2071 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:30.319813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 305/612] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:35:30.366976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef7423-8aec-4d0e-851b-ed3f145b650e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:30.436897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd95633-38db-4d45-a325-5f0db83a2071 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:30.483442 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa106a1-4bca-47f3-9545-80a38dfd8e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:30.484242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa106a1-4bca-47f3-9545-80a38dfd8e05 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:30.484592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa106a1-4bca-47f3-9545-80a38dfd8e05 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:30.484932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa106a1-4bca-47f3-9545-80a38dfd8e05 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:30.485759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa106a1-4bca-47f3-9545-80a38dfd8e05 None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:30.486131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa106a1-4bca-47f3-9545-80a38dfd8e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:30.487551 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa106a1-4bca-47f3-9545-80a38dfd8e05 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:30.489543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef7423-8aec-4d0e-851b-ed3f145b650e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:30.496322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 308/613] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:30.501906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa106a1-4bca-47f3-9545-80a38dfd8e05 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:30.530191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580ef24-26ec-4461-a096-58f3f23b46c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:30.531016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580ef24-26ec-4461-a096-58f3f23b46c2 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:30.531296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580ef24-26ec-4461-a096-58f3f23b46c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:30.531568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580ef24-26ec-4461-a096-58f3f23b46c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:30.544652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580ef24-26ec-4461-a096-58f3f23b46c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-a580ef24-26ec-4461-a096-58f3f23b46c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:30.553810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:30.555949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:30.557943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 306/614] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:30.563815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580ef24-26ec-4461-a096-58f3f23b46c2 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:30.652279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa106a1-4bca-47f3-9545-80a38dfd8e05 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:30.691266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9194334-74a4-4a90-869d-012fc199756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:30.692012 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194334-74a4-4a90-869d-012fc199756d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:30.692288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194334-74a4-4a90-869d-012fc199756d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:30.692916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194334-74a4-4a90-869d-012fc199756d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:30.705232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9194334-74a4-4a90-869d-012fc199756d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:30.707732 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9194334-74a4-4a90-869d-012fc199756d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-b9194334-74a4-4a90-869d-012fc199756d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:30.727439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:30.730100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:30.732508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:30.732508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:30.732508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:30.732508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:30.732508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 309/615] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:30.735755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9194334-74a4-4a90-869d-012fc199756d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:30.758600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580ef24-26ec-4461-a096-58f3f23b46c2 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:30.814798 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087bbfa-0a36-47bf-805c-7dcec8513d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:30.815325 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087bbfa-0a36-47bf-805c-7dcec8513d16 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:30.815609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087bbfa-0a36-47bf-805c-7dcec8513d16 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:30.815917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087bbfa-0a36-47bf-805c-7dcec8513d16 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:30.816667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087bbfa-0a36-47bf-805c-7dcec8513d16 None admin] RBAC: Adding query filter params (name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:30.816974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087bbfa-0a36-47bf-805c-7dcec8513d16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:30.819343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087bbfa-0a36-47bf-805c-7dcec8513d16 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:30.828532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 307/616] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:30.833758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087bbfa-0a36-47bf-805c-7dcec8513d16 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:30.838476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9194334-74a4-4a90-869d-012fc199756d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:30.880421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab97e-0a28-4149-9645-9cd4d4d50cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:30.881399 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab97e-0a28-4149-9645-9cd4d4d50cd1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:30.881882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab97e-0a28-4149-9645-9cd4d4d50cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:30.882344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab97e-0a28-4149-9645-9cd4d4d50cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:30.883246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ab97e-0a28-4149-9645-9cd4d4d50cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:30.883740 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ab97e-0a28-4149-9645-9cd4d4d50cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:30.885820 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ab97e-0a28-4149-9645-9cd4d4d50cd1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:30.906496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 310/617] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:30.912104 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab97e-0a28-4149-9645-9cd4d4d50cd1 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:30.944173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087bbfa-0a36-47bf-805c-7dcec8513d16 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:30.978757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1f006-ed33-47de-851e-cdc56241c877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:30.979250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1f006-ed33-47de-851e-cdc56241c877 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:30.979533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1f006-ed33-47de-851e-cdc56241c877 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:30.979837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1f006-ed33-47de-851e-cdc56241c877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:30.990444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1f006-ed33-47de-851e-cdc56241c877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:30.991991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1f006-ed33-47de-851e-cdc56241c877 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:31.026644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab97e-0a28-4149-9645-9cd4d4d50cd1 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-3ad1f006-ed33-47de-851e-cdc56241c877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:31.031643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:31.032642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:31.033506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:31.033506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:31.033506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:31.033506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:31.042483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 308/618] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:31.047879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1f006-ed33-47de-851e-cdc56241c877 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:31.079434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d95e1-22d1-465a-98a5-75812beb7e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:31.080619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d95e1-22d1-465a-98a5-75812beb7e9a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:31.081098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d95e1-22d1-465a-98a5-75812beb7e9a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:31.081567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d95e1-22d1-465a-98a5-75812beb7e9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:31.089367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d95e1-22d1-465a-98a5-75812beb7e9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:31.091168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d95e1-22d1-465a-98a5-75812beb7e9a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-2b7d95e1-22d1-465a-98a5-75812beb7e9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:31.107367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:31.108329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:31.109253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:31.109253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:31.109253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:31.109253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:31.109253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:31.109253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:31.109253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:31.109253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:31.109253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:31.109253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:31.115839 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 311/619] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:31.117854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d95e1-22d1-465a-98a5-75812beb7e9a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:31.221671 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d95e1-22d1-465a-98a5-75812beb7e9a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:31.256361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd63128-7b32-4eb8-a903-434592a1426f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:31.257346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd63128-7b32-4eb8-a903-434592a1426f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:31.257977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd63128-7b32-4eb8-a903-434592a1426f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:31.258475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd63128-7b32-4eb8-a903-434592a1426f None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:31.259506 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd63128-7b32-4eb8-a903-434592a1426f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:31.260724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd63128-7b32-4eb8-a903-434592a1426f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:31.262341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd63128-7b32-4eb8-a903-434592a1426f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:31.281083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 312/620] 10.222.0.72 () {56 vars in 1135 bytes} [Mon May 16 18:35:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:31.286954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd63128-7b32-4eb8-a903-434592a1426f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:31.399744 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd63128-7b32-4eb8-a903-434592a1426f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:31.406876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1f006-ed33-47de-851e-cdc56241c877 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:31.439146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfd446-9a0e-4f9e-a5aa-2471f5a223d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:31.440591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfd446-9a0e-4f9e-a5aa-2471f5a223d1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:31.441098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfd446-9a0e-4f9e-a5aa-2471f5a223d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:31.441565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfd446-9a0e-4f9e-a5aa-2471f5a223d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:31.453119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfd446-9a0e-4f9e-a5aa-2471f5a223d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:31.454857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfd446-9a0e-4f9e-a5aa-2471f5a223d1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-b5bfd446-9a0e-4f9e-a5aa-2471f5a223d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:31.475335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:31.476283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:31.477176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:31.477176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:31.477176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:31.477176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:31.479534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 313/621] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:31.485010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314ee20-2151-4249-aa6c-7a60bc49c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:31.485444 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfd446-9a0e-4f9e-a5aa-2471f5a223d1 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:31.485690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ee20-2151-4249-aa6c-7a60bc49c3ef None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:31.485972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ee20-2151-4249-aa6c-7a60bc49c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:31.486248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ee20-2151-4249-aa6c-7a60bc49c3ef None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:31.486982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314ee20-2151-4249-aa6c-7a60bc49c3ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:31.487283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314ee20-2151-4249-aa6c-7a60bc49c3ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:31.492833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314ee20-2151-4249-aa6c-7a60bc49c3ef None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:31.518430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 309/622] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:31.523952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314ee20-2151-4249-aa6c-7a60bc49c3ef None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:31.606763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfd446-9a0e-4f9e-a5aa-2471f5a223d1 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:31.656458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634b91a-3ce3-4f12-a5ef-2868a7de6a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:31.657535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634b91a-3ce3-4f12-a5ef-2868a7de6a2f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:31.658024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634b91a-3ce3-4f12-a5ef-2868a7de6a2f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:31.658495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634b91a-3ce3-4f12-a5ef-2868a7de6a2f None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:31.661710 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634b91a-3ce3-4f12-a5ef-2868a7de6a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:31.662244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634b91a-3ce3-4f12-a5ef-2868a7de6a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:31.665088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634b91a-3ce3-4f12-a5ef-2868a7de6a2f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:31.696532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 314/623] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:31.716219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634b91a-3ce3-4f12-a5ef-2868a7de6a2f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:31.754810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314ee20-2151-4249-aa6c-7a60bc49c3ef None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:31.833726 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634b91a-3ce3-4f12-a5ef-2868a7de6a2f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:31.868936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194d988-35ea-494b-a16e-387bbe052064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:31.871260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194d988-35ea-494b-a16e-387bbe052064 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:31.871799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194d988-35ea-494b-a16e-387bbe052064 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:31.872285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194d988-35ea-494b-a16e-387bbe052064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:31.879951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194d988-35ea-494b-a16e-387bbe052064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:31.881641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194d988-35ea-494b-a16e-387bbe052064 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:31.893753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab1724-d388-4be8-b07b-af618c99c6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:31.894554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab1724-d388-4be8-b07b-af618c99c6e4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:31.894834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab1724-d388-4be8-b07b-af618c99c6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:31.895108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab1724-d388-4be8-b07b-af618c99c6e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-2194d988-35ea-494b-a16e-387bbe052064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:31.898144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:31.898975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:31.899877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:31.899877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:31.899877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:31.899877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:31.899877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:31.899877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:31.899877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:31.899877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:31.903396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 315/624] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:31.909011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab1724-d388-4be8-b07b-af618c99c6e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:31.910902 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194d988-35ea-494b-a16e-387bbe052064 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:31.913617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab1724-d388-4be8-b07b-af618c99c6e4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-49ab1724-d388-4be8-b07b-af618c99c6e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:31.929222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:31.930163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:31.931085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:31.931085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:31.931085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:31.931085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:31.931085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:31.931085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:31.931085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:31.931085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:31.931085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:31.931085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:31.931085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 310/625] 10.222.0.72 () {56 vars in 1093 bytes} [Mon May 16 18:35:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:31.943735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab1724-d388-4be8-b07b-af618c99c6e4 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:32.048629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab1724-d388-4be8-b07b-af618c99c6e4 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:32.085631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bde01d-53fa-415e-a12a-1a96008b6132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:32.087023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bde01d-53fa-415e-a12a-1a96008b6132 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:32.087385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bde01d-53fa-415e-a12a-1a96008b6132 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:32.087463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bde01d-53fa-415e-a12a-1a96008b6132 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:32.089617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bde01d-53fa-415e-a12a-1a96008b6132 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:32.089937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bde01d-53fa-415e-a12a-1a96008b6132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:32.091812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bde01d-53fa-415e-a12a-1a96008b6132 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:32.112922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 311/626] 10.222.0.72 () {56 vars in 1133 bytes} [Mon May 16 18:35:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:32.118315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bde01d-53fa-415e-a12a-1a96008b6132 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:32.137770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194d988-35ea-494b-a16e-387bbe052064 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:32.226353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bde01d-53fa-415e-a12a-1a96008b6132 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:32.248386 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b47b22-41f1-45e9-89d1-f0bf70aa9a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:32.249375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b47b22-41f1-45e9-89d1-f0bf70aa9a96 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:32.249854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b47b22-41f1-45e9-89d1-f0bf70aa9a96 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:32.250359 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b47b22-41f1-45e9-89d1-f0bf70aa9a96 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:32.251364 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b47b22-41f1-45e9-89d1-f0bf70aa9a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:32.251893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b47b22-41f1-45e9-89d1-f0bf70aa9a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:32.253521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b47b22-41f1-45e9-89d1-f0bf70aa9a96 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:32.265353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09c131-1229-4369-ba54-52ba4f0a40a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:32.266005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09c131-1229-4369-ba54-52ba4f0a40a5 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:32.266286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09c131-1229-4369-ba54-52ba4f0a40a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:32.266561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09c131-1229-4369-ba54-52ba4f0a40a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:32.272641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 316/627] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:32.285795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b47b22-41f1-45e9-89d1-f0bf70aa9a96 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:32.483214 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09c131-1229-4369-ba54-52ba4f0a40a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:32.485808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09c131-1229-4369-ba54-52ba4f0a40a5 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:32.553938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b47b22-41f1-45e9-89d1-f0bf70aa9a96 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:32.597293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 312/628] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:32.598838 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288d41-28e6-45dd-8a4b-c055c7a62a63 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:32.599132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288d41-28e6-45dd-8a4b-c055c7a62a63 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:32.599412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288d41-28e6-45dd-8a4b-c055c7a62a63 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:32.600946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 313/629] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:32.602547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288d41-28e6-45dd-8a4b-c055c7a62a63 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:32.604144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0f180-346f-412d-aa0b-2fb899efc039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:32.605435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0f180-346f-412d-aa0b-2fb899efc039 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:32.606618 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0f180-346f-412d-aa0b-2fb899efc039 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:32.606990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0f180-346f-412d-aa0b-2fb899efc039 None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/55231d7b40cb4479b9a6580a0f0b7cb0/roles/07ebf23e49074f6ca9b1f96878f4fa7b` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:32.628248 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0f180-346f-412d-aa0b-2fb899efc039 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=55231d7b40cb4479b9a6580a0f0b7cb0, role_id=07ebf23e49074f6ca9b1f96878f4fa7b)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:32.629693 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0f180-346f-412d-aa0b-2fb899efc039 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:32.651974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 317/630] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:35:32 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/55231d7b40cb4479b9a6580a0f0b7cb0/roles/07ebf23e49074f6ca9b1f96878f4fa7b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:35:32.651974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e769-a637-4046-8a52-75b66cc68708 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:32.651974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e769-a637-4046-8a52-75b66cc68708 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:32.651974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e769-a637-4046-8a52-75b66cc68708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:32.686382 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-b7b3e769-a637-4046-8a52-75b66cc68708 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:32.687639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b7b3e769-a637-4046-8a52-75b66cc68708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:32.768867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288d41-28e6-45dd-8a4b-c055c7a62a63 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:32.814402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 318/631] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:32.833162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c1134-3896-4bca-acc4-eeda2be1f49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:32.834219 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c1134-3896-4bca-acc4-eeda2be1f49c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:32.834684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c1134-3896-4bca-acc4-eeda2be1f49c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:32.835102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c1134-3896-4bca-acc4-eeda2be1f49c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:32.859691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c1134-3896-4bca-acc4-eeda2be1f49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:32.859912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3e769-a637-4046-8a52-75b66cc68708 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:32.861652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c1134-3896-4bca-acc4-eeda2be1f49c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-395c1134-3896-4bca-acc4-eeda2be1f49c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:32.887567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:32.888558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:32.889448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:32.889448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:32.889448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:32.889448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:32.889448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 314/632] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:32.890462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84dc25-dae6-4312-9bed-1c1e0ff0fc28 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:32.890744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84dc25-dae6-4312-9bed-1c1e0ff0fc28 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:32.891032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84dc25-dae6-4312-9bed-1c1e0ff0fc28 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:32.897767 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 315/633] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:32.899485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84dc25-dae6-4312-9bed-1c1e0ff0fc28 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:32.977786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3e769-a637-4046-8a52-75b66cc68708 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:33.018640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84dc25-dae6-4312-9bed-1c1e0ff0fc28 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:33.018840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31352640-b324-473a-9d4e-73d7fa0eb910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:33.019556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31352640-b324-473a-9d4e-73d7fa0eb910 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.019815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31352640-b324-473a-9d4e-73d7fa0eb910 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.020088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31352640-b324-473a-9d4e-73d7fa0eb910 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.033734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31352640-b324-473a-9d4e-73d7fa0eb910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-31352640-b324-473a-9d4e-73d7fa0eb910 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:33.042025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:33.042988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:33.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:33.046832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 319/634] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:33.052939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d13a-1c49-49ce-9e89-fdf419b52f83 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.053499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d13a-1c49-49ce-9e89-fdf419b52f83 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.054049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d13a-1c49-49ce-9e89-fdf419b52f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.057676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9534931-1563-48ae-9c99-2d0210e6e796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:33.058465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534931-1563-48ae-9c99-2d0210e6e796 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.058846 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534931-1563-48ae-9c99-2d0210e6e796 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.059216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534931-1563-48ae-9c99-2d0210e6e796 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.060075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9534931-1563-48ae-9c99-2d0210e6e796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:33.060473 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9534931-1563-48ae-9c99-2d0210e6e796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:33.061947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9534931-1563-48ae-9c99-2d0210e6e796 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:33.073596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d531d13a-1c49-49ce-9e89-fdf419b52f83 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:33.074033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 316/635] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:33.074935 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9534931-1563-48ae-9c99-2d0210e6e796 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:33.075514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d531d13a-1c49-49ce-9e89-fdf419b52f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:33.148211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 320/636] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:33.149349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531d13a-1c49-49ce-9e89-fdf419b52f83 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:33.226457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9534931-1563-48ae-9c99-2d0210e6e796 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:33.250992 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531d13a-1c49-49ce-9e89-fdf419b52f83 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:33.264918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604d314-cef8-40aa-80aa-bc4ed9c9b7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:33.265588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d314-cef8-40aa-80aa-bc4ed9c9b7c3 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.265860 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d314-cef8-40aa-80aa-bc4ed9c9b7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.266135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d314-cef8-40aa-80aa-bc4ed9c9b7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.266881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604d314-cef8-40aa-80aa-bc4ed9c9b7c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:33.267184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604d314-cef8-40aa-80aa-bc4ed9c9b7c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:33.268577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604d314-cef8-40aa-80aa-bc4ed9c9b7c3 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:33.277679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 317/637] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:33.281772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604d314-cef8-40aa-80aa-bc4ed9c9b7c3 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:33.299982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83465baf-f21c-43b0-8e10-c3eb2f8ebf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:33.300843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83465baf-f21c-43b0-8e10-c3eb2f8ebf40 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.301123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83465baf-f21c-43b0-8e10-c3eb2f8ebf40 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.301395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83465baf-f21c-43b0-8e10-c3eb2f8ebf40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.310103 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83465baf-f21c-43b0-8e10-c3eb2f8ebf40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:33.311596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83465baf-f21c-43b0-8e10-c3eb2f8ebf40 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-83465baf-f21c-43b0-8e10-c3eb2f8ebf40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:33.326959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:33.327972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:33.328846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:33.328846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:33.328846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:33.328846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:33.328846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:33.328846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:33.328846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:33.328846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:33.328846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 321/638] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:33.329815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83465baf-f21c-43b0-8e10-c3eb2f8ebf40 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:33.391213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604d314-cef8-40aa-80aa-bc4ed9c9b7c3 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:33.424693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c1300-1df8-4846-b7ec-bcaf92722525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:33.425490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c1300-1df8-4846-b7ec-bcaf92722525 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.425769 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c1300-1df8-4846-b7ec-bcaf92722525 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.426040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c1300-1df8-4846-b7ec-bcaf92722525 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.433892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83465baf-f21c-43b0-8e10-c3eb2f8ebf40 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:33.436366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c1300-1df8-4846-b7ec-bcaf92722525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-022c1300-1df8-4846-b7ec-bcaf92722525 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:33.444101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:33.446220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:33.448878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:33.455828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 318/639] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:33.455828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c1300-1df8-4846-b7ec-bcaf92722525 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:33.469679 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af8d4-6f39-4064-bf0a-3c40f62f5a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:33.470476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af8d4-6f39-4064-bf0a-3c40f62f5a52 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.470756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af8d4-6f39-4064-bf0a-3c40f62f5a52 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.471028 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af8d4-6f39-4064-bf0a-3c40f62f5a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.481922 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7af8d4-6f39-4064-bf0a-3c40f62f5a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:33.483420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7af8d4-6f39-4064-bf0a-3c40f62f5a52 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-2c7af8d4-6f39-4064-bf0a-3c40f62f5a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:33.500979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:33.503448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:33.505610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:33.505610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:33.505610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:33.505610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:33.505610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 322/640] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:33.505610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af8d4-6f39-4064-bf0a-3c40f62f5a52 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:33.567017 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c1300-1df8-4846-b7ec-bcaf92722525 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:33.606218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af8d4-6f39-4064-bf0a-3c40f62f5a52 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:33.607099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffab34b-0bb8-433c-a9a6-65f1aa58d66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:33.607787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffab34b-0bb8-433c-a9a6-65f1aa58d66e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.608075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffab34b-0bb8-433c-a9a6-65f1aa58d66e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.608356 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffab34b-0bb8-433c-a9a6-65f1aa58d66e None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.609144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffab34b-0bb8-433c-a9a6-65f1aa58d66e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:33.609450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffab34b-0bb8-433c-a9a6-65f1aa58d66e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:33.610872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffab34b-0bb8-433c-a9a6-65f1aa58d66e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:33.622732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 319/641] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:33.628257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffab34b-0bb8-433c-a9a6-65f1aa58d66e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:33.640912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da89734-f5f8-449d-8b8e-4f6ab18d7699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:33.641581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da89734-f5f8-449d-8b8e-4f6ab18d7699 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.641858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da89734-f5f8-449d-8b8e-4f6ab18d7699 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.642189 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da89734-f5f8-449d-8b8e-4f6ab18d7699 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.642939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da89734-f5f8-449d-8b8e-4f6ab18d7699 None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:33.643285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da89734-f5f8-449d-8b8e-4f6ab18d7699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:33.644686 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da89734-f5f8-449d-8b8e-4f6ab18d7699 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:33.657520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 323/642] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:33.657520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15bb2-3169-4931-9e41-5dcddd0abebb None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.657520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15bb2-3169-4931-9e41-5dcddd0abebb None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.657520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15bb2-3169-4931-9e41-5dcddd0abebb None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.657520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 324/643] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:33.657520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a15bb2-3169-4931-9e41-5dcddd0abebb None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:33.736304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffab34b-0bb8-433c-a9a6-65f1aa58d66e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:33.757133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a15bb2-3169-4931-9e41-5dcddd0abebb None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:33.769725 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61859750-bcba-43cd-9435-dff7f2614b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:33.770391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61859750-bcba-43cd-9435-dff7f2614b53 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.770674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61859750-bcba-43cd-9435-dff7f2614b53 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.770957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61859750-bcba-43cd-9435-dff7f2614b53 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.771678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61859750-bcba-43cd-9435-dff7f2614b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:33.772015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61859750-bcba-43cd-9435-dff7f2614b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:33.773379 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61859750-bcba-43cd-9435-dff7f2614b53 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:33.784668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 320/644] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:33.789161 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61859750-bcba-43cd-9435-dff7f2614b53 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:33.794191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9bbad-ea05-4a1c-96f2-942760197d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:33.794846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9bbad-ea05-4a1c-96f2-942760197d3d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.795126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9bbad-ea05-4a1c-96f2-942760197d3d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.795393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9bbad-ea05-4a1c-96f2-942760197d3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.796260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9bbad-ea05-4a1c-96f2-942760197d3d None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=cc09bfcc0d8c4d20a156b3b08ffafa34) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:33.796566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9bbad-ea05-4a1c-96f2-942760197d3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:33.797976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9bbad-ea05-4a1c-96f2-942760197d3d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:33.803762 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 325/645] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:33 2022] GET /identity/v3/role_assignments?user.id=cc09bfcc0d8c4d20a156b3b08ffafa34&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:33.812149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f960659-7b08-4648-b8af-72a5a2f405c1 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.812786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f960659-7b08-4648-b8af-72a5a2f405c1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.813349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f960659-7b08-4648-b8af-72a5a2f405c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.832421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2f960659-7b08-4648-b8af-72a5a2f405c1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:33.834060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2f960659-7b08-4648-b8af-72a5a2f405c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:33.899065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61859750-bcba-43cd-9435-dff7f2614b53 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:33.908973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 326/646] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:33.910273 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f960659-7b08-4648-b8af-72a5a2f405c1 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:33.937132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a813c-0bff-40d8-9850-77cb86bf9b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:33.938368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a813c-0bff-40d8-9850-77cb86bf9b33 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:33.938368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a813c-0bff-40d8-9850-77cb86bf9b33 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:33.938830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a813c-0bff-40d8-9850-77cb86bf9b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:33.952344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a813c-0bff-40d8-9850-77cb86bf9b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:33.953933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a813c-0bff-40d8-9850-77cb86bf9b33 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-eb7a813c-0bff-40d8-9850-77cb86bf9b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:33.972676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:33.973689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:33.974674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:33.974674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:33.974674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:33.974674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:33.974674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 321/647] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:33.979659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a813c-0bff-40d8-9850-77cb86bf9b33 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:34.023208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f960659-7b08-4648-b8af-72a5a2f405c1 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:34.066879 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437430b-92ee-4368-b2fb-7a1ce8aca884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:34.068020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437430b-92ee-4368-b2fb-7a1ce8aca884 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:34.068470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437430b-92ee-4368-b2fb-7a1ce8aca884 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:34.068911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437430b-92ee-4368-b2fb-7a1ce8aca884 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:34.077904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437430b-92ee-4368-b2fb-7a1ce8aca884 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:34.079563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437430b-92ee-4368-b2fb-7a1ce8aca884 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-b437430b-92ee-4368-b2fb-7a1ce8aca884 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:34.096967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:34.097941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:34.098878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:34.098878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:34.098878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:34.098878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:34.098878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:34.098878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:34.098878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:34.098878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:34.098878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:35:34.098878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:34.101370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 327/648] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:34.102296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437430b-92ee-4368-b2fb-7a1ce8aca884 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:34.107732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a813c-0bff-40d8-9850-77cb86bf9b33 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:34.154290 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f491b6-f882-4f28-8a78-71ff2dae1cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:34.155094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f491b6-f882-4f28-8a78-71ff2dae1cfe None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:34.155753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f491b6-f882-4f28-8a78-71ff2dae1cfe None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:34.156044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f491b6-f882-4f28-8a78-71ff2dae1cfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:34.169885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f491b6-f882-4f28-8a78-71ff2dae1cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-c7f491b6-f882-4f28-8a78-71ff2dae1cfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:34.180358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:34.181490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:34.183078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 322/649] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:34.183904 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f491b6-f882-4f28-8a78-71ff2dae1cfe None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:34.221466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437430b-92ee-4368-b2fb-7a1ce8aca884 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:34.258832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c763cd-7255-4869-9942-25453eba26eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:34.259543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c763cd-7255-4869-9942-25453eba26eb None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:34.259874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c763cd-7255-4869-9942-25453eba26eb None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:34.260154 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c763cd-7255-4869-9942-25453eba26eb None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:34.260878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c763cd-7255-4869-9942-25453eba26eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:34.261179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c763cd-7255-4869-9942-25453eba26eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:34.262959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c763cd-7255-4869-9942-25453eba26eb None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:34.274120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 328/650] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:34.275004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c763cd-7255-4869-9942-25453eba26eb None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:34.297302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f491b6-f882-4f28-8a78-71ff2dae1cfe None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:34.331362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b1656-394e-4078-ab0c-f22e3f48804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:34.332409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b1656-394e-4078-ab0c-f22e3f48804e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:34.332893 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b1656-394e-4078-ab0c-f22e3f48804e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:34.333390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b1656-394e-4078-ab0c-f22e3f48804e None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:34.334443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b1656-394e-4078-ab0c-f22e3f48804e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:34.334944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b1656-394e-4078-ab0c-f22e3f48804e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:34.336659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b1656-394e-4078-ab0c-f22e3f48804e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:34.359564 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 323/651] 10.222.0.72 () {56 vars in 1137 bytes} [Mon May 16 18:35:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:34.360801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b1656-394e-4078-ab0c-f22e3f48804e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:34.382112 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c763cd-7255-4869-9942-25453eba26eb None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:34.416875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daba416-e176-46b2-86b8-0554bc7f27da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:34.417717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daba416-e176-46b2-86b8-0554bc7f27da None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:34.417999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daba416-e176-46b2-86b8-0554bc7f27da None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:34.418274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daba416-e176-46b2-86b8-0554bc7f27da None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:34.419084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daba416-e176-46b2-86b8-0554bc7f27da None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:34.419387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daba416-e176-46b2-86b8-0554bc7f27da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:34.420817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daba416-e176-46b2-86b8-0554bc7f27da None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:34.433788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 329/652] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:34.434727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daba416-e176-46b2-86b8-0554bc7f27da None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:34.461782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b1656-394e-4078-ab0c-f22e3f48804e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:34.497283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a172-baaf-4ef5-8670-dcfa7a17c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:34.498470 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a172-baaf-4ef5-8670-dcfa7a17c185 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:34.498952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a172-baaf-4ef5-8670-dcfa7a17c185 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:34.499447 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a172-baaf-4ef5-8670-dcfa7a17c185 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:34.506974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a172-baaf-4ef5-8670-dcfa7a17c185 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:34.508698 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a172-baaf-4ef5-8670-dcfa7a17c185 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-0cc1a172-baaf-4ef5-8670-dcfa7a17c185 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:34.523611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:34.524624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:34.526263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:34.526263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:34.526263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:34.526263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:34.526263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:34.526263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:34.526263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:34.526263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:34.526263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 18:35:34.526263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:34.529077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 324/653] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:34.530156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a172-baaf-4ef5-8670-dcfa7a17c185 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:34.536612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daba416-e176-46b2-86b8-0554bc7f27da None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:34.571339 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aea5d5-4576-48bc-9887-f30a7ee7d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:34.572019 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aea5d5-4576-48bc-9887-f30a7ee7d510 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:34.572862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aea5d5-4576-48bc-9887-f30a7ee7d510 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:34.573125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aea5d5-4576-48bc-9887-f30a7ee7d510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:34.631042 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a172-baaf-4ef5-8670-dcfa7a17c185 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:34.665752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aea5d5-4576-48bc-9887-f30a7ee7d510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:34.666872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b3f9-9c5e-487e-bf79-b1f3aab234fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:34.667355 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aea5d5-4576-48bc-9887-f30a7ee7d510 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:34.668165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b3f9-9c5e-487e-bf79-b1f3aab234fe None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:34.668665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b3f9-9c5e-487e-bf79-b1f3aab234fe None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:34.669242 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b3f9-9c5e-487e-bf79-b1f3aab234fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:34.679801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26b3f9-9c5e-487e-bf79-b1f3aab234fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:34.681520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26b3f9-9c5e-487e-bf79-b1f3aab234fe None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-ab26b3f9-9c5e-487e-bf79-b1f3aab234fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:34.701023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:34.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:34.702892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:34.702892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:34.702892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:34.702892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:34.705192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 325/654] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:34.706215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b3f9-9c5e-487e-bf79-b1f3aab234fe None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:34.776287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 330/655] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:34.777240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aea5d5-4576-48bc-9887-f30a7ee7d510 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:34.811631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b3f9-9c5e-487e-bf79-b1f3aab234fe None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:34.846440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f163db-9323-4a3e-ac25-6392986a96e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:34.847467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f163db-9323-4a3e-ac25-6392986a96e5 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:34.847997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f163db-9323-4a3e-ac25-6392986a96e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:34.848491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f163db-9323-4a3e-ac25-6392986a96e5 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:34.849523 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f163db-9323-4a3e-ac25-6392986a96e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:34.850045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f163db-9323-4a3e-ac25-6392986a96e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:34.851672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f163db-9323-4a3e-ac25-6392986a96e5 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:34.870614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 326/656] 10.222.0.72 () {56 vars in 1137 bytes} [Mon May 16 18:35:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:34.871839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f163db-9323-4a3e-ac25-6392986a96e5 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:34.878748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aea5d5-4576-48bc-9887-f30a7ee7d510 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:34.915151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a510da-59d1-4789-b0a7-f2fc0034c5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:34.915667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a510da-59d1-4789-b0a7-f2fc0034c5ce None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:34.916503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a510da-59d1-4789-b0a7-f2fc0034c5ce None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:34.916837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a510da-59d1-4789-b0a7-f2fc0034c5ce None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:34.917568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a510da-59d1-4789-b0a7-f2fc0034c5ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:34.917869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a510da-59d1-4789-b0a7-f2fc0034c5ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:34.919234 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a510da-59d1-4789-b0a7-f2fc0034c5ce None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:34.941685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 331/657] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:34.942969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a510da-59d1-4789-b0a7-f2fc0034c5ce None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:34.979807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f163db-9323-4a3e-ac25-6392986a96e5 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:35.015353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462543e-07b6-4dff-a448-52a0fb43fa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:35.016564 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462543e-07b6-4dff-a448-52a0fb43fa33 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.017050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462543e-07b6-4dff-a448-52a0fb43fa33 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.017518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462543e-07b6-4dff-a448-52a0fb43fa33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.028368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462543e-07b6-4dff-a448-52a0fb43fa33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:35.030139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462543e-07b6-4dff-a448-52a0fb43fa33 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-9462543e-07b6-4dff-a448-52a0fb43fa33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:35.048925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:35.049839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:35.050727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:35.050727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:35.050727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:35.050727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:35.051977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a510da-59d1-4789-b0a7-f2fc0034c5ce None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:35.053555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 327/658] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:35.054542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462543e-07b6-4dff-a448-52a0fb43fa33 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:35.091534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff238dea-a522-4f68-8f3c-fb84b22de551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:35.092286 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238dea-a522-4f68-8f3c-fb84b22de551 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.092552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238dea-a522-4f68-8f3c-fb84b22de551 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.092792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238dea-a522-4f68-8f3c-fb84b22de551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.160663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462543e-07b6-4dff-a448-52a0fb43fa33 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:35.161324 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff238dea-a522-4f68-8f3c-fb84b22de551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:35.163382 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff238dea-a522-4f68-8f3c-fb84b22de551 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:35.195015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4885cac-c3c5-47e9-a53c-3efca3c401f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:35.195755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4885cac-c3c5-47e9-a53c-3efca3c401f2 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.196040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4885cac-c3c5-47e9-a53c-3efca3c401f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.196316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4885cac-c3c5-47e9-a53c-3efca3c401f2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.204455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4885cac-c3c5-47e9-a53c-3efca3c401f2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:35.206159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4885cac-c3c5-47e9-a53c-3efca3c401f2 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-c4885cac-c3c5-47e9-a53c-3efca3c401f2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:35.220985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:35.222130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:35.223247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:35.223247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:35.223247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:35.223247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:35.223247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:35.223247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:35.223247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:35.223247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:35.223247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 18:35:35.223247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:35.226576 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 328/659] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:35.227377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4885cac-c3c5-47e9-a53c-3efca3c401f2 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:35.269362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 332/660] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:35.275074 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680275cb-36b0-49b4-8ab5-e8f4240f4de5 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.276023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680275cb-36b0-49b4-8ab5-e8f4240f4de5 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.276310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680275cb-36b0-49b4-8ab5-e8f4240f4de5 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.281833 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 333/661] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:35.281833 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680275cb-36b0-49b4-8ab5-e8f4240f4de5 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:35.326707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4885cac-c3c5-47e9-a53c-3efca3c401f2 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:35.362547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae476e1d-1076-46c8-8cf7-be8eae1eba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:35.363301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae476e1d-1076-46c8-8cf7-be8eae1eba12 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.363564 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae476e1d-1076-46c8-8cf7-be8eae1eba12 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.363872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae476e1d-1076-46c8-8cf7-be8eae1eba12 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.364591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae476e1d-1076-46c8-8cf7-be8eae1eba12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:35.364894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae476e1d-1076-46c8-8cf7-be8eae1eba12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:35.366258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae476e1d-1076-46c8-8cf7-be8eae1eba12 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:35.382311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 329/662] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:35.382311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae476e1d-1076-46c8-8cf7-be8eae1eba12 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:35.387973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680275cb-36b0-49b4-8ab5-e8f4240f4de5 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:35.421418 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261962ce-88e6-404e-9668-e9bacfd3c987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:35.422089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261962ce-88e6-404e-9668-e9bacfd3c987 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.422369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261962ce-88e6-404e-9668-e9bacfd3c987 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.422641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261962ce-88e6-404e-9668-e9bacfd3c987 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.423479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261962ce-88e6-404e-9668-e9bacfd3c987 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:35.423819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261962ce-88e6-404e-9668-e9bacfd3c987 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:35.425241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261962ce-88e6-404e-9668-e9bacfd3c987 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:35.442189 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 334/663] 10.222.0.72 () {56 vars in 1139 bytes} [Mon May 16 18:35:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:35.443417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29694-a0ea-465d-a983-37f6fcd41d9a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.443704 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29694-a0ea-465d-a983-37f6fcd41d9a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.444007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29694-a0ea-465d-a983-37f6fcd41d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.460034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-47a29694-a0ea-465d-a983-37f6fcd41d9a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:35.461148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-47a29694-a0ea-465d-a983-37f6fcd41d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:35.484528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae476e1d-1076-46c8-8cf7-be8eae1eba12 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:35.517792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e2cdb-4a7b-4506-b680-1065439cb414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:35.518592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e2cdb-4a7b-4506-b680-1065439cb414 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.518878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e2cdb-4a7b-4506-b680-1065439cb414 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.519161 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e2cdb-4a7b-4506-b680-1065439cb414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.526689 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 335/664] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:35.527834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a29694-a0ea-465d-a983-37f6fcd41d9a None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:35.538641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e2cdb-4a7b-4506-b680-1065439cb414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:35.540709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e2cdb-4a7b-4506-b680-1065439cb414 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-f94e2cdb-4a7b-4506-b680-1065439cb414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:35.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:35.565865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:35.566764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:35.566764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:35.566764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:35.566764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:35.566764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 330/665] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:35.567491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e2cdb-4a7b-4506-b680-1065439cb414 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:35.633646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a29694-a0ea-465d-a983-37f6fcd41d9a None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:35.668561 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a80f-e0ae-4f4b-9179-8ddfa097a985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:35.669105 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e2cdb-4a7b-4506-b680-1065439cb414 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:35.669353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a80f-e0ae-4f4b-9179-8ddfa097a985 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.669631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a80f-e0ae-4f4b-9179-8ddfa097a985 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.670259 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a80f-e0ae-4f4b-9179-8ddfa097a985 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.677002 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a80f-e0ae-4f4b-9179-8ddfa097a985 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:35.678430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a80f-e0ae-4f4b-9179-8ddfa097a985 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-b569a80f-e0ae-4f4b-9179-8ddfa097a985 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:35.692315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:35.693417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:35.694375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:35.694375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:35.694375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:35.694375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:35.694375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:35.694375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:35.694375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:35.694375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:35.694375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 336/666] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:35.695261 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a80f-e0ae-4f4b-9179-8ddfa097a985 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:35.709997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5169c31-dbf2-4dcb-a93a-16cb2c5df720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:35.710703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5169c31-dbf2-4dcb-a93a-16cb2c5df720 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.710991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5169c31-dbf2-4dcb-a93a-16cb2c5df720 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.711275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5169c31-dbf2-4dcb-a93a-16cb2c5df720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.779431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5169c31-dbf2-4dcb-a93a-16cb2c5df720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:35.780930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5169c31-dbf2-4dcb-a93a-16cb2c5df720 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:35.797650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a80f-e0ae-4f4b-9179-8ddfa097a985 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:35.830286 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba4c75-62af-4af6-a3d1-31891b5c4b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:35.831071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba4c75-62af-4af6-a3d1-31891b5c4b6e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.831350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba4c75-62af-4af6-a3d1-31891b5c4b6e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.831618 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba4c75-62af-4af6-a3d1-31891b5c4b6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.842498 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba4c75-62af-4af6-a3d1-31891b5c4b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-2bba4c75-62af-4af6-a3d1-31891b5c4b6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:35.850564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:35.851539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 337/667] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:35.853089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba4c75-62af-4af6-a3d1-31891b5c4b6e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:35.885362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 331/668] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:35.885362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5169c31-dbf2-4dcb-a93a-16cb2c5df720 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:35.958863 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba4c75-62af-4af6-a3d1-31891b5c4b6e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:35.984629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5169c31-dbf2-4dcb-a93a-16cb2c5df720 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:35.991756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd88ebe-1408-44e8-84fe-404261f3661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:35.992479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd88ebe-1408-44e8-84fe-404261f3661f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:35.992764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd88ebe-1408-44e8-84fe-404261f3661f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:35.993036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd88ebe-1408-44e8-84fe-404261f3661f None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:35.993761 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd88ebe-1408-44e8-84fe-404261f3661f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:35.994566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd88ebe-1408-44e8-84fe-404261f3661f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:35.996042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd88ebe-1408-44e8-84fe-404261f3661f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.008236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 338/669] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:36.009116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd88ebe-1408-44e8-84fe-404261f3661f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.023337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65397b7-3416-43bd-9727-51bfa2d161d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.024348 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65397b7-3416-43bd-9727-51bfa2d161d4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.024627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65397b7-3416-43bd-9727-51bfa2d161d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.024901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65397b7-3416-43bd-9727-51bfa2d161d4 None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.026305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65397b7-3416-43bd-9727-51bfa2d161d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:36.026609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65397b7-3416-43bd-9727-51bfa2d161d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:36.028125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65397b7-3416-43bd-9727-51bfa2d161d4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.040719 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 332/670] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:36.044755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65397b7-3416-43bd-9727-51bfa2d161d4 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.115681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd88ebe-1408-44e8-84fe-404261f3661f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:36.144124 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65397b7-3416-43bd-9727-51bfa2d161d4 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:36.148392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9222c2-1cba-4f3e-b68d-2f38d96f7a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.149061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9222c2-1cba-4f3e-b68d-2f38d96f7a5c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.149341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9222c2-1cba-4f3e-b68d-2f38d96f7a5c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.149612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9222c2-1cba-4f3e-b68d-2f38d96f7a5c None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.150870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9222c2-1cba-4f3e-b68d-2f38d96f7a5c None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:36.151160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9222c2-1cba-4f3e-b68d-2f38d96f7a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:36.152538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9222c2-1cba-4f3e-b68d-2f38d96f7a5c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.160366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 339/671] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:36.161211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9222c2-1cba-4f3e-b68d-2f38d96f7a5c None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.182928 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f78b01-8e9d-40f4-8461-a5e89e7bfa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.183748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78b01-8e9d-40f4-8461-a5e89e7bfa56 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.184032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78b01-8e9d-40f4-8461-a5e89e7bfa56 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.184299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78b01-8e9d-40f4-8461-a5e89e7bfa56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.195893 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78b01-8e9d-40f4-8461-a5e89e7bfa56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:36.197408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78b01-8e9d-40f4-8461-a5e89e7bfa56 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-72f78b01-8e9d-40f4-8461-a5e89e7bfa56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:36.215810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:36.216747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:36.217612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:36.217612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:36.217612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:36.217612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:36.217612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 333/672] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:36.217891 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f78b01-8e9d-40f4-8461-a5e89e7bfa56 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.259769 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9222c2-1cba-4f3e-b68d-2f38d96f7a5c None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:36.292505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0c01c-a327-424e-9ade-14f85479fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.293322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0c01c-a327-424e-9ade-14f85479fedf None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.293683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0c01c-a327-424e-9ade-14f85479fedf None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.293954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0c01c-a327-424e-9ade-14f85479fedf None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.300572 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0c01c-a327-424e-9ade-14f85479fedf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:36.302004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0c01c-a327-424e-9ade-14f85479fedf None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.312765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f78b01-8e9d-40f4-8461-a5e89e7bfa56 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-c1c0c01c-a327-424e-9ade-14f85479fedf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:36.316057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:36.317008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:36.317885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:36.317885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:36.317885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:36.317885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:36.317885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:36.317885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:36.317885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:36.317885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:36.317885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 340/673] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:36.318358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0c01c-a327-424e-9ade-14f85479fedf None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.346089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02239a2-f579-46ef-a8ab-046fffbc0967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.346742 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02239a2-f579-46ef-a8ab-046fffbc0967 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.347025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02239a2-f579-46ef-a8ab-046fffbc0967 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.347297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02239a2-f579-46ef-a8ab-046fffbc0967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.348175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02239a2-f579-46ef-a8ab-046fffbc0967 None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=eb06ac74276c4238b178a2467013348c) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:36.348485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02239a2-f579-46ef-a8ab-046fffbc0967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:36.349900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02239a2-f579-46ef-a8ab-046fffbc0967 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.355776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 334/674] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/role_assignments?user.id=eb06ac74276c4238b178a2467013348c&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:36.356981 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e019d3-cb08-44eb-b6e8-b421d9422046 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.357266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e019d3-cb08-44eb-b6e8-b421d9422046 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.357543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e019d3-cb08-44eb-b6e8-b421d9422046 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.362951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 335/675] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:36.362951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e019d3-cb08-44eb-b6e8-b421d9422046 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.421840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0c01c-a327-424e-9ade-14f85479fedf None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:36.457479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b71804-0877-40aa-ae11-8725d28a35d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.458653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b71804-0877-40aa-ae11-8725d28a35d1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.458939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b71804-0877-40aa-ae11-8725d28a35d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.459215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b71804-0877-40aa-ae11-8725d28a35d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.471612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b71804-0877-40aa-ae11-8725d28a35d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:36.473242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b71804-0877-40aa-ae11-8725d28a35d1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.476790 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e019d3-cb08-44eb-b6e8-b421d9422046 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-b1b71804-0877-40aa-ae11-8725d28a35d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:36.492550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:36.493717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:36.494851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:36.494851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:36.494851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:36.494851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:36.498629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 341/676] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:36.499421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b71804-0877-40aa-ae11-8725d28a35d1 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.515380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f690600-2ffc-4256-89bf-b9af213d5da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.515999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f690600-2ffc-4256-89bf-b9af213d5da4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.516289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f690600-2ffc-4256-89bf-b9af213d5da4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.516566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f690600-2ffc-4256-89bf-b9af213d5da4 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.517303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f690600-2ffc-4256-89bf-b9af213d5da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:36.517610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f690600-2ffc-4256-89bf-b9af213d5da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:36.519004 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f690600-2ffc-4256-89bf-b9af213d5da4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.535335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 336/677] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:36.535335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536b728-0c50-431b-82f9-2f835ffb3b02 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.535335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536b728-0c50-431b-82f9-2f835ffb3b02 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.535335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536b728-0c50-431b-82f9-2f835ffb3b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.551857 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0536b728-0c50-431b-82f9-2f835ffb3b02 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:36.553020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0536b728-0c50-431b-82f9-2f835ffb3b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:36.602220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b71804-0877-40aa-ae11-8725d28a35d1 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:36.621630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 337/678] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:36.622478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536b728-0c50-431b-82f9-2f835ffb3b02 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.636829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feed7a-c5cd-4688-bf8c-04fa176a806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.637498 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feed7a-c5cd-4688-bf8c-04fa176a806d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.637777 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feed7a-c5cd-4688-bf8c-04fa176a806d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.638052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feed7a-c5cd-4688-bf8c-04fa176a806d None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.638851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9feed7a-c5cd-4688-bf8c-04fa176a806d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:36.639159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9feed7a-c5cd-4688-bf8c-04fa176a806d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:36.640619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9feed7a-c5cd-4688-bf8c-04fa176a806d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.652957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 342/679] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:36.653789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feed7a-c5cd-4688-bf8c-04fa176a806d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.726739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536b728-0c50-431b-82f9-2f835ffb3b02 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:36.750410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feed7a-c5cd-4688-bf8c-04fa176a806d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:36.761186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01f150-a20a-47cf-9d42-325b589daaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.761908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f150-a20a-47cf-9d42-325b589daaa4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.762124 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f150-a20a-47cf-9d42-325b589daaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.762400 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01f150-a20a-47cf-9d42-325b589daaa4 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.763189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01f150-a20a-47cf-9d42-325b589daaa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:36.763423 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01f150-a20a-47cf-9d42-325b589daaa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:36.764836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01f150-a20a-47cf-9d42-325b589daaa4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.776320 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 338/680] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:36.777053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01f150-a20a-47cf-9d42-325b589daaa4 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.786185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc47a1-01b3-4438-a55d-e6362777d3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.787190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc47a1-01b3-4438-a55d-e6362777d3f2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.787619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc47a1-01b3-4438-a55d-e6362777d3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.788068 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc47a1-01b3-4438-a55d-e6362777d3f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.795391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc47a1-01b3-4438-a55d-e6362777d3f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:36.797063 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc47a1-01b3-4438-a55d-e6362777d3f2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-d8bc47a1-01b3-4438-a55d-e6362777d3f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:36.811759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:36.812816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:36.813905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:36.813905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:36.813905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:36.813905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:36.813905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:36.813905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:36.813905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:36.813905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:36.815985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 343/681] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:36.816901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc47a1-01b3-4438-a55d-e6362777d3f2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.880611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01f150-a20a-47cf-9d42-325b589daaa4 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:36.916321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc47a1-01b3-4438-a55d-e6362777d3f2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:36.917806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ec95a-7efe-43e4-b348-0e0ed781093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.919143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ec95a-7efe-43e4-b348-0e0ed781093d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.919143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ec95a-7efe-43e4-b348-0e0ed781093d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.919143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ec95a-7efe-43e4-b348-0e0ed781093d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.933078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ec95a-7efe-43e4-b348-0e0ed781093d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-0d6ec95a-7efe-43e4-b348-0e0ed781093d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:36.941572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:36.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:36.943329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 339/682] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:36.944626 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ec95a-7efe-43e4-b348-0e0ed781093d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:36.956531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d9ee7-b58c-45bc-9a2b-3c5491458be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:36.957494 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d9ee7-b58c-45bc-9a2b-3c5491458be2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:36.957777 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d9ee7-b58c-45bc-9a2b-3c5491458be2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:36.958042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d9ee7-b58c-45bc-9a2b-3c5491458be2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:36.958876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d9ee7-b58c-45bc-9a2b-3c5491458be2 None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=6f0e623c10804239a076fc6cde9b198d) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:36.959187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d9ee7-b58c-45bc-9a2b-3c5491458be2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:36.960634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d9ee7-b58c-45bc-9a2b-3c5491458be2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:36.966711 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 344/683] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/role_assignments?user.id=6f0e623c10804239a076fc6cde9b198d&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:36.967468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d9ee7-b58c-45bc-9a2b-3c5491458be2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:37.075976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d9ee7-b58c-45bc-9a2b-3c5491458be2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:37.088219 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ec95a-7efe-43e4-b348-0e0ed781093d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:37.113452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142792f4-7664-4ee0-a16b-55f1a8d4844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:37.114160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142792f4-7664-4ee0-a16b-55f1a8d4844d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:37.114438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142792f4-7664-4ee0-a16b-55f1a8d4844d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:37.114713 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142792f4-7664-4ee0-a16b-55f1a8d4844d None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:37.115587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142792f4-7664-4ee0-a16b-55f1a8d4844d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:37.115924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142792f4-7664-4ee0-a16b-55f1a8d4844d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:37.117848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142792f4-7664-4ee0-a16b-55f1a8d4844d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:37.130842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 345/684] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:37.131736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142792f4-7664-4ee0-a16b-55f1a8d4844d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:37.135347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0a8b5-8856-4599-a41f-abd4c221538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:37.137292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a8b5-8856-4599-a41f-abd4c221538e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:37.137754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a8b5-8856-4599-a41f-abd4c221538e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:37.138177 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a8b5-8856-4599-a41f-abd4c221538e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:37.149108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0a8b5-8856-4599-a41f-abd4c221538e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:37.151185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0a8b5-8856-4599-a41f-abd4c221538e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-bdb0a8b5-8856-4599-a41f-abd4c221538e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:37.172143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:37.173117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:37.174077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:37.174077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:37.174077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:37.174077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:37.174077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:37.174077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:37.174077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:37.174077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:37.174077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:37.174077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:37.176977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 340/685] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:37.178024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0a8b5-8856-4599-a41f-abd4c221538e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:37.246477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142792f4-7664-4ee0-a16b-55f1a8d4844d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:37.293405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fedd27-2695-46dd-b254-1fe6809527e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:37.294042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fedd27-2695-46dd-b254-1fe6809527e0 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:37.294325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fedd27-2695-46dd-b254-1fe6809527e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:37.294609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fedd27-2695-46dd-b254-1fe6809527e0 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:37.295336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fedd27-2695-46dd-b254-1fe6809527e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:37.295637 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fedd27-2695-46dd-b254-1fe6809527e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:37.297028 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fedd27-2695-46dd-b254-1fe6809527e0 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:37.308503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 346/686] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:37.309923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fedd27-2695-46dd-b254-1fe6809527e0 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:37.311357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0a8b5-8856-4599-a41f-abd4c221538e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:37.354347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94ff39-cdd9-4558-8577-507cd74ce292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:37.355371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ff39-cdd9-4558-8577-507cd74ce292 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:37.356021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ff39-cdd9-4558-8577-507cd74ce292 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:37.356497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ff39-cdd9-4558-8577-507cd74ce292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:37.357605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94ff39-cdd9-4558-8577-507cd74ce292 None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=c22a0fc8a3914f7fb3356a84827db326) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:37.358128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94ff39-cdd9-4558-8577-507cd74ce292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:37.359784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94ff39-cdd9-4558-8577-507cd74ce292 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:37.366301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 341/687] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:37 2022] GET /identity/v3/role_assignments?user.id=c22a0fc8a3914f7fb3356a84827db326&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:37.367331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94ff39-cdd9-4558-8577-507cd74ce292 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:37.455513 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fedd27-2695-46dd-b254-1fe6809527e0 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:37.492235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c6569-4a98-44dc-8475-535e8b973ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:37.493321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c6569-4a98-44dc-8475-535e8b973ded None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:37.493805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c6569-4a98-44dc-8475-535e8b973ded None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:37.494785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c6569-4a98-44dc-8475-535e8b973ded None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:37.495906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c6569-4a98-44dc-8475-535e8b973ded None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:37.496437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c6569-4a98-44dc-8475-535e8b973ded None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:37.498187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c6569-4a98-44dc-8475-535e8b973ded None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:37.519270 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 347/688] 10.222.0.72 () {56 vars in 1135 bytes} [Mon May 16 18:35:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:37.525698 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c6569-4a98-44dc-8475-535e8b973ded None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:37.581398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94ff39-cdd9-4558-8577-507cd74ce292 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:37.628136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a1870-79b6-4030-8b94-9f4efc6e62f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:37.628955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a1870-79b6-4030-8b94-9f4efc6e62f3 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:37.629239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a1870-79b6-4030-8b94-9f4efc6e62f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:37.629517 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a1870-79b6-4030-8b94-9f4efc6e62f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:37.633821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c6569-4a98-44dc-8475-535e8b973ded None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:37.649025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a1870-79b6-4030-8b94-9f4efc6e62f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:37.650604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a1870-79b6-4030-8b94-9f4efc6e62f3 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:37.668801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bad0a-816f-4284-b5d6-ca616ac0e27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-f02a1870-79b6-4030-8b94-9f4efc6e62f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:37.669145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:37.670107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:37.670983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:37.670983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:37.670983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:37.670983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:37.671199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bad0a-816f-4284-b5d6-ca616ac0e27f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:37.671199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bad0a-816f-4284-b5d6-ca616ac0e27f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:37.671199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bad0a-816f-4284-b5d6-ca616ac0e27f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:37.671382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 342/689] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:37.676713 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a1870-79b6-4030-8b94-9f4efc6e62f3 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:37.755965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bad0a-816f-4284-b5d6-ca616ac0e27f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:37.758153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bad0a-816f-4284-b5d6-ca616ac0e27f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:37.795424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a1870-79b6-4030-8b94-9f4efc6e62f3 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:37.833355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa60f2-bbd4-4c01-8ba1-b7d0f5e9c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:37.834963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa60f2-bbd4-4c01-8ba1-b7d0f5e9c556 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:37.835454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa60f2-bbd4-4c01-8ba1-b7d0f5e9c556 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:37.835957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa60f2-bbd4-4c01-8ba1-b7d0f5e9c556 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:37.836890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa60f2-bbd4-4c01-8ba1-b7d0f5e9c556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:37.837497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa60f2-bbd4-4c01-8ba1-b7d0f5e9c556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:37.840278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa60f2-bbd4-4c01-8ba1-b7d0f5e9c556 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:37.859230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 343/690] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:37.864553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa60f2-bbd4-4c01-8ba1-b7d0f5e9c556 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:37.879459 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 348/691] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:37.891084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bad0a-816f-4284-b5d6-ca616ac0e27f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:37.991483 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bad0a-816f-4284-b5d6-ca616ac0e27f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:38.031148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70316d93-336b-458d-bc0c-33f93eee6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:38.031976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316d93-336b-458d-bc0c-33f93eee6c85 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:38.032255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316d93-336b-458d-bc0c-33f93eee6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:38.032524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316d93-336b-458d-bc0c-33f93eee6c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:38.047380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70316d93-336b-458d-bc0c-33f93eee6c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:38.048844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70316d93-336b-458d-bc0c-33f93eee6c85 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-70316d93-336b-458d-bc0c-33f93eee6c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:38.069904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:38.070877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:38.071764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:38.071764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:38.071764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:38.071764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:38.071764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 349/692] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:38.080740 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70316d93-336b-458d-bc0c-33f93eee6c85 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:38.097522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa60f2-bbd4-4c01-8ba1-b7d0f5e9c556 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:38.157626 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8284600-13df-4428-a36a-5b6e70245fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:38.158403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8284600-13df-4428-a36a-5b6e70245fb4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:38.158690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8284600-13df-4428-a36a-5b6e70245fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:38.163748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8284600-13df-4428-a36a-5b6e70245fb4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:38.166229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8284600-13df-4428-a36a-5b6e70245fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:38.167784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8284600-13df-4428-a36a-5b6e70245fb4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-a8284600-13df-4428-a36a-5b6e70245fb4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:38.183324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:38.184328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:38.185261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:38.185261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:38.185261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:38.185261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:38.185261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:38.185261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:38.185261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:38.185261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:38.185261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:38.185261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:38.185261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 344/693] 10.222.0.72 () {56 vars in 1093 bytes} [Mon May 16 18:35:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:38.190297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8284600-13df-4428-a36a-5b6e70245fb4 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:38.249856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70316d93-336b-458d-bc0c-33f93eee6c85 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:38.295171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a2c30-156d-4343-bba2-1f8df26beb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:38.296224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2c30-156d-4343-bba2-1f8df26beb95 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:38.296705 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2c30-156d-4343-bba2-1f8df26beb95 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:38.297174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2c30-156d-4343-bba2-1f8df26beb95 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:38.298119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a2c30-156d-4343-bba2-1f8df26beb95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:38.298616 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a2c30-156d-4343-bba2-1f8df26beb95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:38.298994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8284600-13df-4428-a36a-5b6e70245fb4 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:38.300513 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a2c30-156d-4343-bba2-1f8df26beb95 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:38.327456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 350/694] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:38.339032 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a2c30-156d-4343-bba2-1f8df26beb95 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:38.341697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7da54-b505-4262-baa9-5750fa829835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:38.342381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7da54-b505-4262-baa9-5750fa829835 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:38.342666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7da54-b505-4262-baa9-5750fa829835 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:38.342944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7da54-b505-4262-baa9-5750fa829835 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:38.344082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7da54-b505-4262-baa9-5750fa829835 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:38.344497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7da54-b505-4262-baa9-5750fa829835 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:38.346074 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7da54-b505-4262-baa9-5750fa829835 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:38.364646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 345/695] 10.222.0.72 () {56 vars in 1133 bytes} [Mon May 16 18:35:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:38.370560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7da54-b505-4262-baa9-5750fa829835 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:38.472811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7da54-b505-4262-baa9-5750fa829835 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:38.511365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c3271-59b1-4820-b859-00c3711754c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:38.512045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c3271-59b1-4820-b859-00c3711754c5 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:38.513065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c3271-59b1-4820-b859-00c3711754c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:38.513350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c3271-59b1-4820-b859-00c3711754c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:38.568870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a2c30-156d-4343-bba2-1f8df26beb95 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:38.608543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e54a85-44b4-46e8-bc18-bd065efd8601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:38.609707 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54a85-44b4-46e8-bc18-bd065efd8601 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:38.610184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54a85-44b4-46e8-bc18-bd065efd8601 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:38.610650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e54a85-44b4-46e8-bc18-bd065efd8601 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:38.623095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e54a85-44b4-46e8-bc18-bd065efd8601 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:38.626000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e54a85-44b4-46e8-bc18-bd065efd8601 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-e4e54a85-44b4-46e8-bc18-bd065efd8601 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:38.649066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:38.650014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:38.650932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:38.650932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:38.650932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:38.650932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:38.650932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:38.650932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:38.650932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:38.650932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:38.655315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c3271-59b1-4820-b859-00c3711754c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:38.657035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c3271-59b1-4820-b859-00c3711754c5 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:38.660719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 351/696] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:38.666958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e54a85-44b4-46e8-bc18-bd065efd8601 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:38.771739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e54a85-44b4-46e8-bc18-bd065efd8601 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:38.820986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49df218-7abc-4db3-ac90-827f41292530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:38.822029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49df218-7abc-4db3-ac90-827f41292530 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:38.823048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49df218-7abc-4db3-ac90-827f41292530 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:38.823539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49df218-7abc-4db3-ac90-827f41292530 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:38.824552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49df218-7abc-4db3-ac90-827f41292530 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:38.825057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49df218-7abc-4db3-ac90-827f41292530 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:38.826682 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49df218-7abc-4db3-ac90-827f41292530 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:38.840394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 352/697] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:38.847619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49df218-7abc-4db3-ac90-827f41292530 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:38.861897 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 346/698] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:38.867146 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c3271-59b1-4820-b859-00c3711754c5 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:38.996543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49df218-7abc-4db3-ac90-827f41292530 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:39.036839 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963380c-8ccb-45e9-9576-9325494ded89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:39.037846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963380c-8ccb-45e9-9576-9325494ded89 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.038328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963380c-8ccb-45e9-9576-9325494ded89 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.038794 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963380c-8ccb-45e9-9576-9325494ded89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.039882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963380c-8ccb-45e9-9576-9325494ded89 None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=55231d7b40cb4479b9a6580a0f0b7cb0) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:39.040846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963380c-8ccb-45e9-9576-9325494ded89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:39.042853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963380c-8ccb-45e9-9576-9325494ded89 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:39.051419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 353/699] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:38 2022] GET /identity/v3/role_assignments?user.id=55231d7b40cb4479b9a6580a0f0b7cb0&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:39.053029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10395c1c-be64-4225-bc75-30d721cbff86 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.053520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10395c1c-be64-4225-bc75-30d721cbff86 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.054015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10395c1c-be64-4225-bc75-30d721cbff86 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.060855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 354/700] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:39.063398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095eb8a-3db4-488b-bdad-4ea8db48ded3 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.064096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095eb8a-3db4-488b-bdad-4ea8db48ded3 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.064601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095eb8a-3db4-488b-bdad-4ea8db48ded3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.085899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-9095eb8a-3db4-488b-bdad-4ea8db48ded3 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:39.087495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9095eb8a-3db4-488b-bdad-4ea8db48ded3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:39.092280 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c3271-59b1-4820-b859-00c3711754c5 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:39.214255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 355/701] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:35:39.250985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095eb8a-3db4-488b-bdad-4ea8db48ded3 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:39.306706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8219f2-5ac3-47f8-8af4-395cecdc4706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:39.308230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8219f2-5ac3-47f8-8af4-395cecdc4706 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.308733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8219f2-5ac3-47f8-8af4-395cecdc4706 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.309209 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8219f2-5ac3-47f8-8af4-395cecdc4706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.321692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8219f2-5ac3-47f8-8af4-395cecdc4706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:39.326165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8219f2-5ac3-47f8-8af4-395cecdc4706 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-5e8219f2-5ac3-47f8-8af4-395cecdc4706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:39.347568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:39.348549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:39.349440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:39.349440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:39.349440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:39.349440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:39.351921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 347/702] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 485 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:39.358112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8219f2-5ac3-47f8-8af4-395cecdc4706 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:39.426456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095eb8a-3db4-488b-bdad-4ea8db48ded3 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:39.466538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8e8d-c0de-49ba-a7c7-315442c8e0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:39.467339 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8e8d-c0de-49ba-a7c7-315442c8e0e8 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.467615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8e8d-c0de-49ba-a7c7-315442c8e0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.467915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8e8d-c0de-49ba-a7c7-315442c8e0e8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.468832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf8e8d-c0de-49ba-a7c7-315442c8e0e8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:39.470206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf8e8d-c0de-49ba-a7c7-315442c8e0e8 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:39.470812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8219f2-5ac3-47f8-8af4-395cecdc4706 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-44bf8e8d-c0de-49ba-a7c7-315442c8e0e8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:39.487511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:39.488866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:39.489730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 356/703] 10.222.0.72 () {56 vars in 1129 bytes} [Mon May 16 18:35:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:39.497043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8e8d-c0de-49ba-a7c7-315442c8e0e8 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:39.517336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3ab4-8de7-42eb-ae7f-5b0e901d8c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:39.518019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3ab4-8de7-42eb-ae7f-5b0e901d8c7e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.518298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3ab4-8de7-42eb-ae7f-5b0e901d8c7e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.518570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c3ab4-8de7-42eb-ae7f-5b0e901d8c7e None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.519296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c3ab4-8de7-42eb-ae7f-5b0e901d8c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:39.519598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c3ab4-8de7-42eb-ae7f-5b0e901d8c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:39.520998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c3ab4-8de7-42eb-ae7f-5b0e901d8c7e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:39.536110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 348/704] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:39.541996 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3ab4-8de7-42eb-ae7f-5b0e901d8c7e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:39.631059 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8e8d-c0de-49ba-a7c7-315442c8e0e8 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:39.661733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c3ab4-8de7-42eb-ae7f-5b0e901d8c7e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:39.667884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903889a-6a97-4752-ad83-5e625a4f77fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:39.668695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903889a-6a97-4752-ad83-5e625a4f77fa None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.669084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903889a-6a97-4752-ad83-5e625a4f77fa None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.669462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903889a-6a97-4752-ad83-5e625a4f77fa None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.670287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903889a-6a97-4752-ad83-5e625a4f77fa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:39.670692 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903889a-6a97-4752-ad83-5e625a4f77fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:39.672216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903889a-6a97-4752-ad83-5e625a4f77fa None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:39.677323 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 357/705] 10.222.0.72 () {56 vars in 1124 bytes} [Mon May 16 18:35:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:39.678724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde2adb-8d99-4fb1-b475-d2a85ce1c746 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.679096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde2adb-8d99-4fb1-b475-d2a85ce1c746 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.679475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde2adb-8d99-4fb1-b475-d2a85ce1c746 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.681176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 358/706] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:39.687511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e9ec-8ed2-41ad-b4b3-aef3b3b9b730 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.688112 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e9ec-8ed2-41ad-b4b3-aef3b3b9b730 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.688302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e9ec-8ed2-41ad-b4b3-aef3b3b9b730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.704328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020c8e0-94b9-43b3-b15c-9270fbfa75fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:39.705391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c8e0-94b9-43b3-b15c-9270fbfa75fc None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.705820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c8e0-94b9-43b3-b15c-9270fbfa75fc None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.706246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c8e0-94b9-43b3-b15c-9270fbfa75fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.706940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8b09e9ec-8ed2-41ad-b4b3-aef3b3b9b730 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:39.708320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8b09e9ec-8ed2-41ad-b4b3-aef3b3b9b730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:39.716691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020c8e0-94b9-43b3-b15c-9270fbfa75fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:39.719111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020c8e0-94b9-43b3-b15c-9270fbfa75fc None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-1020c8e0-94b9-43b3-b15c-9270fbfa75fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:39.738221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:39.739346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:39.740476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:39.740476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:39.740476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:39.740476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:39.740476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:39.740476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:39.740476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:39.740476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:39.743092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 349/707] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:39.745393 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020c8e0-94b9-43b3-b15c-9270fbfa75fc None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:39.786892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 359/708] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:39.788172 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e9ec-8ed2-41ad-b4b3-aef3b3b9b730 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:39.855185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020c8e0-94b9-43b3-b15c-9270fbfa75fc None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:39.892195 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2224bac-8f49-4496-824c-d1a6b3b6115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:39.893031 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2224bac-8f49-4496-824c-d1a6b3b6115f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.893442 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2224bac-8f49-4496-824c-d1a6b3b6115f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.894642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2224bac-8f49-4496-824c-d1a6b3b6115f None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.895632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2224bac-8f49-4496-824c-d1a6b3b6115f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:39.896189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2224bac-8f49-4496-824c-d1a6b3b6115f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:39.898313 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2224bac-8f49-4496-824c-d1a6b3b6115f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:39.906300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 350/709] 10.222.0.72 () {56 vars in 1124 bytes} [Mon May 16 18:35:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:39.907203 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2224bac-8f49-4496-824c-d1a6b3b6115f None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:39.911432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e9ec-8ed2-41ad-b4b3-aef3b3b9b730 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:39.958310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08dd7b-e66f-40d7-a845-e933a5a9b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:39.959252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08dd7b-e66f-40d7-a845-e933a5a9b37f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:39.959818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08dd7b-e66f-40d7-a845-e933a5a9b37f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:39.960239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08dd7b-e66f-40d7-a845-e933a5a9b37f None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:39.961325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08dd7b-e66f-40d7-a845-e933a5a9b37f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:39.961781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08dd7b-e66f-40d7-a845-e933a5a9b37f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:39.964242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08dd7b-e66f-40d7-a845-e933a5a9b37f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:39.986336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 360/710] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:39.988157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08dd7b-e66f-40d7-a845-e933a5a9b37f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:40.076787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2224bac-8f49-4496-824c-d1a6b3b6115f None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:40.135733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff8208-ca30-4557-9e56-f8e99b2e3b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:40.136586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8208-ca30-4557-9e56-f8e99b2e3b5a None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:40.136872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8208-ca30-4557-9e56-f8e99b2e3b5a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:40.137145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8208-ca30-4557-9e56-f8e99b2e3b5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:40.142477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08dd7b-e66f-40d7-a845-e933a5a9b37f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:40.154529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff8208-ca30-4557-9e56-f8e99b2e3b5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:40.156875 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff8208-ca30-4557-9e56-f8e99b2e3b5a None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-ccff8208-ca30-4557-9e56-f8e99b2e3b5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:40.179580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:40.180731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:40.182300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:40.182300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:40.182300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:40.182300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:40.184518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 351/711] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:40.187731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31081c33-3e3a-49b8-aa30-f9a684c19190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:40.187731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31081c33-3e3a-49b8-aa30-f9a684c19190 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:40.187731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31081c33-3e3a-49b8-aa30-f9a684c19190 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:40.187731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31081c33-3e3a-49b8-aa30-f9a684c19190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:40.188125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31081c33-3e3a-49b8-aa30-f9a684c19190 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=cc09bfcc0d8c4d20a156b3b08ffafa34) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:40.188125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31081c33-3e3a-49b8-aa30-f9a684c19190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:40.189527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31081c33-3e3a-49b8-aa30-f9a684c19190 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:40.191093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff8208-ca30-4557-9e56-f8e99b2e3b5a None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:40.196532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 361/712] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:39 2022] GET /identity/v3/role_assignments?user.id=cc09bfcc0d8c4d20a156b3b08ffafa34&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=b104fd2e772843a0974990f965d8b589 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:40.199621 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c15e8b-3206-4379-9e7d-362965ea0bde None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:40.199942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c15e8b-3206-4379-9e7d-362965ea0bde None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:40.200223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c15e8b-3206-4379-9e7d-362965ea0bde None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:40.201596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 362/713] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:40.207612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb46e6-f0c9-4279-9c9b-1b0afc0e7474 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:40.207949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb46e6-f0c9-4279-9c9b-1b0afc0e7474 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:40.208202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb46e6-f0c9-4279-9c9b-1b0afc0e7474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:40.226617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-78cb46e6-f0c9-4279-9c9b-1b0afc0e7474 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:40.227895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-78cb46e6-f0c9-4279-9c9b-1b0afc0e7474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:40.351618 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff8208-ca30-4557-9e56-f8e99b2e3b5a None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:40.363078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 363/714] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 18:35:40.396838 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd66e6-0aac-4904-bc8a-ab36c1b2d29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:40.397042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb46e6-f0c9-4279-9c9b-1b0afc0e7474 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:40.397978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd66e6-0aac-4904-bc8a-ab36c1b2d29a None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:40.398469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd66e6-0aac-4904-bc8a-ab36c1b2d29a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:40.398941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd66e6-0aac-4904-bc8a-ab36c1b2d29a None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:40.399955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd66e6-0aac-4904-bc8a-ab36c1b2d29a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:40.400768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd66e6-0aac-4904-bc8a-ab36c1b2d29a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:40.402532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd66e6-0aac-4904-bc8a-ab36c1b2d29a None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:40.417040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 352/715] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:40.423271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd66e6-0aac-4904-bc8a-ab36c1b2d29a None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:40.523534 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd66e6-0aac-4904-bc8a-ab36c1b2d29a None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:40.523782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb46e6-f0c9-4279-9c9b-1b0afc0e7474 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:40.569335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2c9b1-6339-4662-aebf-f27b07a6f87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:40.570156 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2c9b1-6339-4662-aebf-f27b07a6f87d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:40.570425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2c9b1-6339-4662-aebf-f27b07a6f87d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:40.570701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2c9b1-6339-4662-aebf-f27b07a6f87d None admin] PATH_INFO: `/v3/services/network` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:40.571360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2c9b1-6339-4662-aebf-f27b07a6f87d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:40.573611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2c9b1-6339-4662-aebf-f27b07a6f87d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:40.576901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ff564-6bc4-4f82-93d9-4dd17a305c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:40.577583 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ff564-6bc4-4f82-93d9-4dd17a305c29 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:40.577865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ff564-6bc4-4f82-93d9-4dd17a305c29 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:40.578142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ff564-6bc4-4f82-93d9-4dd17a305c29 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:40.578852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ff564-6bc4-4f82-93d9-4dd17a305c29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:40.580313 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ff564-6bc4-4f82-93d9-4dd17a305c29 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-1ae2c9b1-6339-4662-aebf-f27b07a6f87d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:40.599228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:40.600264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:40.601101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 364/716] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:40 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:40.608936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2c9b1-6339-4662-aebf-f27b07a6f87d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:40.634452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 353/717] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:35:40 2022] POST /identity/v3/users => generated 254 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:35:40.727363 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2c9b1-6339-4662-aebf-f27b07a6f87d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:40.765013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0132b-4e57-41e8-8387-6b0d9f9230c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:40.765699 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0132b-4e57-41e8-8387-6b0d9f9230c8 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:40.765979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0132b-4e57-41e8-8387-6b0d9f9230c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:40.766252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0132b-4e57-41e8-8387-6b0d9f9230c8 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:40.766971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0132b-4e57-41e8-8387-6b0d9f9230c8 None admin] RBAC: Adding query filter params (name=network) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:40.767276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0132b-4e57-41e8-8387-6b0d9f9230c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:40.768675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0132b-4e57-41e8-8387-6b0d9f9230c8 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:40.773939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 365/718] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:35:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:40.780144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ff564-6bc4-4f82-93d9-4dd17a305c29 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:40.887411 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ff564-6bc4-4f82-93d9-4dd17a305c29 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:40.923320 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f25bf-4682-454e-acce-0d9db88bf25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:40.924028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f25bf-4682-454e-acce-0d9db88bf25f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:40.924312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f25bf-4682-454e-acce-0d9db88bf25f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:40.924586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f25bf-4682-454e-acce-0d9db88bf25f None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:40.925303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f25bf-4682-454e-acce-0d9db88bf25f None admin] RBAC: Adding query filter params (type=network) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:40.925606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f25bf-4682-454e-acce-0d9db88bf25f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:40.926992 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f25bf-4682-454e-acce-0d9db88bf25f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:40.932310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 354/719] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:35:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:42.268089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326b795-08b8-4a9d-9843-6d8de824916f None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:42.268609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326b795-08b8-4a9d-9843-6d8de824916f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:42.268609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326b795-08b8-4a9d-9843-6d8de824916f None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:42.270132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 366/720] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:42.276268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6de3d-d07a-4195-92ad-4033a55db686 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:42.276787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6de3d-d07a-4195-92ad-4033a55db686 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:42.276883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6de3d-d07a-4195-92ad-4033a55db686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:42.300230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b8e6de3d-d07a-4195-92ad-4033a55db686 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:42.301413 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b8e6de3d-d07a-4195-92ad-4033a55db686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:42.380052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 355/721] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:42.413737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326b795-08b8-4a9d-9843-6d8de824916f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:42.564494 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326b795-08b8-4a9d-9843-6d8de824916f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:42.608203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f117c6c-0656-43ae-90b0-98bfc25d9d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:42.609021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f117c6c-0656-43ae-90b0-98bfc25d9d1d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:42.609301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f117c6c-0656-43ae-90b0-98bfc25d9d1d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:42.609575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f117c6c-0656-43ae-90b0-98bfc25d9d1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:42.631226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f117c6c-0656-43ae-90b0-98bfc25d9d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-3f117c6c-0656-43ae-90b0-98bfc25d9d1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:42.639380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:42.640349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:42.641260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 367/722] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:42.648002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6de3d-d07a-4195-92ad-4033a55db686 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:42.761009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6de3d-d07a-4195-92ad-4033a55db686 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:42.782927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e5f7-643a-449d-af0e-884f09739c83 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:42.783206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e5f7-643a-449d-af0e-884f09739c83 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:42.783479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e5f7-643a-449d-af0e-884f09739c83 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:42.785120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 368/723] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:42.790031 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d67668-469b-4fc3-9c2c-acfe535597ef None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:42.790314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d67668-469b-4fc3-9c2c-acfe535597ef None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:42.790589 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d67668-469b-4fc3-9c2c-acfe535597ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:42.797758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7c8c4-df99-4847-a82b-07e9bedb7563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:42.798436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7c8c4-df99-4847-a82b-07e9bedb7563 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:42.798718 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7c8c4-df99-4847-a82b-07e9bedb7563 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:42.798989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7c8c4-df99-4847-a82b-07e9bedb7563 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:42.799768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7c8c4-df99-4847-a82b-07e9bedb7563 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:42.800076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7c8c4-df99-4847-a82b-07e9bedb7563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:42.801447 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7c8c4-df99-4847-a82b-07e9bedb7563 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:42.814005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-12d67668-469b-4fc3-9c2c-acfe535597ef None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:42.815654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-12d67668-469b-4fc3-9c2c-acfe535597ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:42.820228 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 356/724] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:42.827560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7c8c4-df99-4847-a82b-07e9bedb7563 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:42.951263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 369/725] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:42.983926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d67668-469b-4fc3-9c2c-acfe535597ef None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:43.001883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7c8c4-df99-4847-a82b-07e9bedb7563 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:43.064257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546075c2-5424-4399-9d0e-ae377cbb7b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:43.065056 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546075c2-5424-4399-9d0e-ae377cbb7b08 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.065335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546075c2-5424-4399-9d0e-ae377cbb7b08 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.065605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546075c2-5424-4399-9d0e-ae377cbb7b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.079220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546075c2-5424-4399-9d0e-ae377cbb7b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:43.081144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546075c2-5424-4399-9d0e-ae377cbb7b08 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-546075c2-5424-4399-9d0e-ae377cbb7b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:43.102879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:43.104425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:43.105338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:43.105338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:43.105338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:43.105338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:43.107791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 357/726] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:43.109313 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a549e-8576-430c-8b77-ea647864b5d4 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.109789 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a549e-8576-430c-8b77-ea647864b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.111273 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a549e-8576-430c-8b77-ea647864b5d4 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.112987 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 358/727] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:43.114978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a549e-8576-430c-8b77-ea647864b5d4 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:43.128871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d67668-469b-4fc3-9c2c-acfe535597ef None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:43.172390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce422a1-12ed-409d-9b4a-edbb11b75397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:43.173779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce422a1-12ed-409d-9b4a-edbb11b75397 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.174540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce422a1-12ed-409d-9b4a-edbb11b75397 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.175065 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce422a1-12ed-409d-9b4a-edbb11b75397 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.176321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce422a1-12ed-409d-9b4a-edbb11b75397 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:43.178208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce422a1-12ed-409d-9b4a-edbb11b75397 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:43.200372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 370/728] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:35:42 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:35:43.201904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306bb2-4816-4245-9bcf-bdf1a2aa14b3 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.202259 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306bb2-4816-4245-9bcf-bdf1a2aa14b3 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.202644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306bb2-4816-4245-9bcf-bdf1a2aa14b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.220710 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-0f306bb2-4816-4245-9bcf-bdf1a2aa14b3 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:43.222010 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0f306bb2-4816-4245-9bcf-bdf1a2aa14b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:43.254261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a549e-8576-430c-8b77-ea647864b5d4 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:43.291887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96455fea-76bd-497e-bfd1-8f8c958f7137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:43.292730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455fea-76bd-497e-bfd1-8f8c958f7137 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.292938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455fea-76bd-497e-bfd1-8f8c958f7137 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.293426 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455fea-76bd-497e-bfd1-8f8c958f7137 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.294323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96455fea-76bd-497e-bfd1-8f8c958f7137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:43.295062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96455fea-76bd-497e-bfd1-8f8c958f7137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:43.296449 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96455fea-76bd-497e-bfd1-8f8c958f7137 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:43.310933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 359/729] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:43.312739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 371/730] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:43.316701 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96455fea-76bd-497e-bfd1-8f8c958f7137 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:43.340429 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f306bb2-4816-4245-9bcf-bdf1a2aa14b3 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:43.457869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f306bb2-4816-4245-9bcf-bdf1a2aa14b3 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:43.503991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c379e-8b89-4029-a7c5-f2c9660941d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:43.505259 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c379e-8b89-4029-a7c5-f2c9660941d9 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.505770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c379e-8b89-4029-a7c5-f2c9660941d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.506264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c379e-8b89-4029-a7c5-f2c9660941d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.520166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c379e-8b89-4029-a7c5-f2c9660941d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-ef4c379e-8b89-4029-a7c5-f2c9660941d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:43.529471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:43.530477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:43.531334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:43.534396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 372/731] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:43.542449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c379e-8b89-4029-a7c5-f2c9660941d9 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:43.548575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96455fea-76bd-497e-bfd1-8f8c958f7137 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:43.589544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328baa3-93cf-4dbb-9e12-37d49923dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:43.590815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328baa3-93cf-4dbb-9e12-37d49923dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.591310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328baa3-93cf-4dbb-9e12-37d49923dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.591822 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328baa3-93cf-4dbb-9e12-37d49923dbd8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.602269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328baa3-93cf-4dbb-9e12-37d49923dbd8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:43.604275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328baa3-93cf-4dbb-9e12-37d49923dbd8 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-5328baa3-93cf-4dbb-9e12-37d49923dbd8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:43.621532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:43.622532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:43.623484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:43.623484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:43.623484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:43.623484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:43.623484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:43.623484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:43.623484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:43.623484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:43.623484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:43.623484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:43.626457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 360/732] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:43.633596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328baa3-93cf-4dbb-9e12-37d49923dbd8 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:43.777053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328baa3-93cf-4dbb-9e12-37d49923dbd8 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:43.798754 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c379e-8b89-4029-a7c5-f2c9660941d9 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:43.816912 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c32dca-edb3-4ee8-86c2-4889115508d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:43.817588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32dca-edb3-4ee8-86c2-4889115508d6 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.817873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32dca-edb3-4ee8-86c2-4889115508d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.818151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32dca-edb3-4ee8-86c2-4889115508d6 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.818997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32dca-edb3-4ee8-86c2-4889115508d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:43.819315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32dca-edb3-4ee8-86c2-4889115508d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:43.820775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32dca-edb3-4ee8-86c2-4889115508d6 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:43.838547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac39155-bfd5-44b5-95be-78cc7c551e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:43.843966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 361/733] 10.222.0.72 () {56 vars in 1135 bytes} [Mon May 16 18:35:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:43.844094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac39155-bfd5-44b5-95be-78cc7c551e97 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.844094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac39155-bfd5-44b5-95be-78cc7c551e97 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.844094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac39155-bfd5-44b5-95be-78cc7c551e97 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.844300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9353-be8c-4b5f-a8ca-578f9c0743bb None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.844380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac39155-bfd5-44b5-95be-78cc7c551e97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:43.844450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9353-be8c-4b5f-a8ca-578f9c0743bb None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.844517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac39155-bfd5-44b5-95be-78cc7c551e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:43.844583 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9353-be8c-4b5f-a8ca-578f9c0743bb None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.844659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac39155-bfd5-44b5-95be-78cc7c551e97 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:43.844728 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 362/734] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:43.844728 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edc2c8-3c86-4396-9c1b-5ec8ea4c98d0 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.844728 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edc2c8-3c86-4396-9c1b-5ec8ea4c98d0 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.844728 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edc2c8-3c86-4396-9c1b-5ec8ea4c98d0 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.845665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 363/735] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:43.848493 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edc2c8-3c86-4396-9c1b-5ec8ea4c98d0 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:43.855086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 373/736] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:43.855086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577d34-2821-4fe5-9eee-865622c201c0 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.855086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577d34-2821-4fe5-9eee-865622c201c0 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.855086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577d34-2821-4fe5-9eee-865622c201c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.872008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a2577d34-2821-4fe5-9eee-865622c201c0 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:43.873181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a2577d34-2821-4fe5-9eee-865622c201c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:43.943202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 374/737] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:43.944398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6d703-455b-44ad-a024-f48829ff6389 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.944734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6d703-455b-44ad-a024-f48829ff6389 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.945007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6d703-455b-44ad-a024-f48829ff6389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:43.957005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edc2c8-3c86-4396-9c1b-5ec8ea4c98d0 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:43.965009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-42a6d703-455b-44ad-a024-f48829ff6389 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:43.966184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-42a6d703-455b-44ad-a024-f48829ff6389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:43.995208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b385-497f-4ef6-8435-0429dd04c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:43.995883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b385-497f-4ef6-8435-0429dd04c91d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:43.996165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b385-497f-4ef6-8435-0429dd04c91d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:43.996693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b385-497f-4ef6-8435-0429dd04c91d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:44.031317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 375/738] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 18:35:44.033048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6d703-455b-44ad-a024-f48829ff6389 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:44.071036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b385-497f-4ef6-8435-0429dd04c91d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:44.074522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b385-497f-4ef6-8435-0429dd04c91d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:44.133789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6d703-455b-44ad-a024-f48829ff6389 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:44.167224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6342700-1fda-4dcb-a9c5-bd77c63c864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:44.168038 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6342700-1fda-4dcb-a9c5-bd77c63c864b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:44.168315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6342700-1fda-4dcb-a9c5-bd77c63c864b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:44.168582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6342700-1fda-4dcb-a9c5-bd77c63c864b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:44.174514 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 364/739] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:43 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 18:35:44.174514 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b385-497f-4ef6-8435-0429dd04c91d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:44.183613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6342700-1fda-4dcb-a9c5-bd77c63c864b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:44.185453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6342700-1fda-4dcb-a9c5-bd77c63c864b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-f6342700-1fda-4dcb-a9c5-bd77c63c864b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:44.203321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:44.204330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:44.205223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:44.205223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:44.205223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:44.205223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:44.205223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 376/740] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:44.205502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6342700-1fda-4dcb-a9c5-bd77c63c864b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:44.271914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b385-497f-4ef6-8435-0429dd04c91d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:44.303519 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6342700-1fda-4dcb-a9c5-bd77c63c864b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:44.307042 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca1789-681c-4afc-b3a0-ce1bf7a9c417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:44.307738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca1789-681c-4afc-b3a0-ce1bf7a9c417 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:44.308025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca1789-681c-4afc-b3a0-ce1bf7a9c417 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:44.308297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca1789-681c-4afc-b3a0-ce1bf7a9c417 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:44.309017 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca1789-681c-4afc-b3a0-ce1bf7a9c417 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:44.310400 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca1789-681c-4afc-b3a0-ce1bf7a9c417 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:44.325934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 365/741] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:35:44 2022] POST /identity/v3/services => generated 240 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:35:44.326762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca1789-681c-4afc-b3a0-ce1bf7a9c417 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:44.359024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb02fbe-c90f-4736-85b9-010e75a07c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:44.361214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb02fbe-c90f-4736-85b9-010e75a07c51 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:44.361896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb02fbe-c90f-4736-85b9-010e75a07c51 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:44.362513 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb02fbe-c90f-4736-85b9-010e75a07c51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:44.380220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb02fbe-c90f-4736-85b9-010e75a07c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-1fb02fbe-c90f-4736-85b9-010e75a07c51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:44.392101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:44.393125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:44.394007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:44.397191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 377/742] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:44.398254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb02fbe-c90f-4736-85b9-010e75a07c51 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:44.453077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca1789-681c-4afc-b3a0-ce1bf7a9c417 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:44.490484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dfe72-5af1-4719-8613-240aea9a5b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:44.491498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dfe72-5af1-4719-8613-240aea9a5b29 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:44.491925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dfe72-5af1-4719-8613-240aea9a5b29 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:44.492297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dfe72-5af1-4719-8613-240aea9a5b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:44.504667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199dfe72-5af1-4719-8613-240aea9a5b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:44.506325 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199dfe72-5af1-4719-8613-240aea9a5b29 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-199dfe72-5af1-4719-8613-240aea9a5b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:44.525954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:44.526954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:44.527874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:44.527874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:44.527874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:44.527874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:44.527874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 366/743] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:44.528855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dfe72-5af1-4719-8613-240aea9a5b29 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:44.530817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb02fbe-c90f-4736-85b9-010e75a07c51 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:44.575923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe3b8d-3c2d-4b6b-bf1e-327a4f06687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:44.576913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe3b8d-3c2d-4b6b-bf1e-327a4f06687a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:44.577421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe3b8d-3c2d-4b6b-bf1e-327a4f06687a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:44.577863 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe3b8d-3c2d-4b6b-bf1e-327a4f06687a None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:44.578823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe3b8d-3c2d-4b6b-bf1e-327a4f06687a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:44.579322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe3b8d-3c2d-4b6b-bf1e-327a4f06687a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:44.580929 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe3b8d-3c2d-4b6b-bf1e-327a4f06687a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:44.594824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 378/744] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:44.595998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe3b8d-3c2d-4b6b-bf1e-327a4f06687a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:44.643819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dfe72-5af1-4719-8613-240aea9a5b29 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:44.685601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04f552-311e-4c1a-b33a-477425fc2e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:44.686910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04f552-311e-4c1a-b33a-477425fc2e61 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:44.687267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04f552-311e-4c1a-b33a-477425fc2e61 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:44.687794 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04f552-311e-4c1a-b33a-477425fc2e61 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:44.688754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04f552-311e-4c1a-b33a-477425fc2e61 None admin] RBAC: Adding query filter params (name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:44.689134 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04f552-311e-4c1a-b33a-477425fc2e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:44.691158 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04f552-311e-4c1a-b33a-477425fc2e61 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:44.702773 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 367/745] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:44.704252 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04f552-311e-4c1a-b33a-477425fc2e61 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:44.706747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe3b8d-3c2d-4b6b-bf1e-327a4f06687a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:44.743231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cecf8-e8f5-44e0-b1c8-3fd37f2e6bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:44.744082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cecf8-e8f5-44e0-b1c8-3fd37f2e6bfb None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:44.744361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cecf8-e8f5-44e0-b1c8-3fd37f2e6bfb None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:44.744640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cecf8-e8f5-44e0-b1c8-3fd37f2e6bfb None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:44.745448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cecf8-e8f5-44e0-b1c8-3fd37f2e6bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:44.745728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cecf8-e8f5-44e0-b1c8-3fd37f2e6bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:44.747039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cecf8-e8f5-44e0-b1c8-3fd37f2e6bfb None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:44.773596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 379/746] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:44.773596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cecf8-e8f5-44e0-b1c8-3fd37f2e6bfb None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:44.832244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04f552-311e-4c1a-b33a-477425fc2e61 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:44.877084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db3c38-1e6d-4292-8e31-0d10049f4b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:44.878040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db3c38-1e6d-4292-8e31-0d10049f4b48 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:44.878327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db3c38-1e6d-4292-8e31-0d10049f4b48 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:44.878604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db3c38-1e6d-4292-8e31-0d10049f4b48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:44.882114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cecf8-e8f5-44e0-b1c8-3fd37f2e6bfb None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:44.888514 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db3c38-1e6d-4292-8e31-0d10049f4b48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:44.889963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db3c38-1e6d-4292-8e31-0d10049f4b48 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-f0db3c38-1e6d-4292-8e31-0d10049f4b48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:44.908168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:44.909159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:44.910096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:44.910096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:44.910096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:44.910096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:44.910096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:44.910096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:44.910096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:44.910096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:44.910096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:44.910096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:44.913891 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 368/747] 10.222.0.72 () {56 vars in 1093 bytes} [Mon May 16 18:35:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:44.914743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db3c38-1e6d-4292-8e31-0d10049f4b48 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:44.923050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bbdb5-a0e5-4eb4-b609-b0c77ff4b0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:44.924228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bbdb5-a0e5-4eb4-b609-b0c77ff4b0f1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:44.924779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bbdb5-a0e5-4eb4-b609-b0c77ff4b0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:44.925274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bbdb5-a0e5-4eb4-b609-b0c77ff4b0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:44.942134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bbdb5-a0e5-4eb4-b609-b0c77ff4b0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:44.944291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bbdb5-a0e5-4eb4-b609-b0c77ff4b0f1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-eb2bbdb5-a0e5-4eb4-b609-b0c77ff4b0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:44.968835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:44.969778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:44.970655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:44.970655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:44.970655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:44.970655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:44.972954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 380/748] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:44.973956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bbdb5-a0e5-4eb4-b609-b0c77ff4b0f1 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:45.022847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db3c38-1e6d-4292-8e31-0d10049f4b48 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:45.057544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56f405-1bd6-4b5b-92af-66cfbf727bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:45.058529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56f405-1bd6-4b5b-92af-66cfbf727bae None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:45.058913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56f405-1bd6-4b5b-92af-66cfbf727bae None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:45.059412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56f405-1bd6-4b5b-92af-66cfbf727bae None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:45.066119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56f405-1bd6-4b5b-92af-66cfbf727bae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:45.067670 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56f405-1bd6-4b5b-92af-66cfbf727bae None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-ea56f405-1bd6-4b5b-92af-66cfbf727bae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:45.082705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:45.083847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:45.084901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:45.084901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:45.084901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:45.084901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:45.084901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:45.084901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:45.084901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:45.084901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:45.090856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 369/749] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:45.091841 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56f405-1bd6-4b5b-92af-66cfbf727bae None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:45.102509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bbdb5-a0e5-4eb4-b609-b0c77ff4b0f1 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:45.146627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d5b2-a654-4493-9f93-f2c0d88055e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:45.147916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d5b2-a654-4493-9f93-f2c0d88055e7 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:45.148417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d5b2-a654-4493-9f93-f2c0d88055e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:45.148876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d5b2-a654-4493-9f93-f2c0d88055e7 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:45.150486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80d5b2-a654-4493-9f93-f2c0d88055e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:45.151178 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80d5b2-a654-4493-9f93-f2c0d88055e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:45.153120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80d5b2-a654-4493-9f93-f2c0d88055e7 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:45.176155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 381/750] 10.222.0.72 () {56 vars in 1133 bytes} [Mon May 16 18:35:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:45.177264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d5b2-a654-4493-9f93-f2c0d88055e7 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:45.201403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56f405-1bd6-4b5b-92af-66cfbf727bae None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:45.241641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4e62c-3a9d-4585-8e24-f19340f15fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:45.243073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4e62c-3a9d-4585-8e24-f19340f15fe9 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:45.243765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4e62c-3a9d-4585-8e24-f19340f15fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:45.244927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4e62c-3a9d-4585-8e24-f19340f15fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:45.246207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4e62c-3a9d-4585-8e24-f19340f15fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:45.247000 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4e62c-3a9d-4585-8e24-f19340f15fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:45.249054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4e62c-3a9d-4585-8e24-f19340f15fe9 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:45.266782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 370/751] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:45.268345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4e62c-3a9d-4585-8e24-f19340f15fe9 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:45.291339 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d5b2-a654-4493-9f93-f2c0d88055e7 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:45.330839 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557abb1f-2393-4e02-8e88-ca423e3dcdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:45.331509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557abb1f-2393-4e02-8e88-ca423e3dcdf1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:45.331832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557abb1f-2393-4e02-8e88-ca423e3dcdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:45.332158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557abb1f-2393-4e02-8e88-ca423e3dcdf1 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:45.332984 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557abb1f-2393-4e02-8e88-ca423e3dcdf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:45.333300 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557abb1f-2393-4e02-8e88-ca423e3dcdf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:45.334724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557abb1f-2393-4e02-8e88-ca423e3dcdf1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:45.347830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 382/752] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:45.348997 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557abb1f-2393-4e02-8e88-ca423e3dcdf1 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:45.397917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4e62c-3a9d-4585-8e24-f19340f15fe9 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:45.443883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe3096-e62c-4fe9-b663-63aa8b3bdbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:45.445141 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe3096-e62c-4fe9-b663-63aa8b3bdbc4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:45.445928 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe3096-e62c-4fe9-b663-63aa8b3bdbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:45.446484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe3096-e62c-4fe9-b663-63aa8b3bdbc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:45.449461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557abb1f-2393-4e02-8e88-ca423e3dcdf1 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:45.459629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe3096-e62c-4fe9-b663-63aa8b3bdbc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:45.461673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe3096-e62c-4fe9-b663-63aa8b3bdbc4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:45.485555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa58b5-07aa-458b-b26f-4bcf5ac16257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-bcbe3096-e62c-4fe9-b663-63aa8b3bdbc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:45.485879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:45.486925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:45.488069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:45.488069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:45.488069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:45.488069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:45.488642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa58b5-07aa-458b-b26f-4bcf5ac16257 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:45.489009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa58b5-07aa-458b-b26f-4bcf5ac16257 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:45.489371 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa58b5-07aa-458b-b26f-4bcf5ac16257 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:45.490467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 371/753] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:45.491407 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe3096-e62c-4fe9-b663-63aa8b3bdbc4 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:45.498582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa58b5-07aa-458b-b26f-4bcf5ac16257 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:45.500246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa58b5-07aa-458b-b26f-4bcf5ac16257 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-d9aa58b5-07aa-458b-b26f-4bcf5ac16257 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:45.516198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:45.517398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:45.518320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:45.518320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:45.518320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:45.518320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:45.518320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:45.518320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:45.518320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:45.518320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:45.518320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:35:45.518320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:45.522647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 383/754] 10.222.0.72 () {56 vars in 1117 bytes} [Mon May 16 18:35:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:45.523471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa58b5-07aa-458b-b26f-4bcf5ac16257 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:45.602786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe3096-e62c-4fe9-b663-63aa8b3bdbc4 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:45.638182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdd110-bea3-46c5-8490-9a2ecca35060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:45.638833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdd110-bea3-46c5-8490-9a2ecca35060 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:45.639119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdd110-bea3-46c5-8490-9a2ecca35060 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:45.639398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdd110-bea3-46c5-8490-9a2ecca35060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:45.640279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdd110-bea3-46c5-8490-9a2ecca35060 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=55231d7b40cb4479b9a6580a0f0b7cb0) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:45.640591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdd110-bea3-46c5-8490-9a2ecca35060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:45.642028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdd110-bea3-46c5-8490-9a2ecca35060 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:45.646268 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa58b5-07aa-458b-b26f-4bcf5ac16257 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:45.648077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 372/755] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:45 2022] GET /identity/v3/role_assignments?user.id=55231d7b40cb4479b9a6580a0f0b7cb0&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=b104fd2e772843a0974990f965d8b589 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:45.649753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdd110-bea3-46c5-8490-9a2ecca35060 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:45.693643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d0836-2b06-495d-8c52-9e32f5b6bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:45.694791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0836-2b06-495d-8c52-9e32f5b6bba2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:45.695287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0836-2b06-495d-8c52-9e32f5b6bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:45.695840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0836-2b06-495d-8c52-9e32f5b6bba2 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:45.696811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d0836-2b06-495d-8c52-9e32f5b6bba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:45.697648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d0836-2b06-495d-8c52-9e32f5b6bba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:45.699387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d0836-2b06-495d-8c52-9e32f5b6bba2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:45.731864 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 384/756] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:45.747218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d0836-2b06-495d-8c52-9e32f5b6bba2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:45.767137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdd110-bea3-46c5-8490-9a2ecca35060 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:45.814011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc688e-9cd9-4f44-bef1-c49a5c96e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:45.814713 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc688e-9cd9-4f44-bef1-c49a5c96e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:45.814998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc688e-9cd9-4f44-bef1-c49a5c96e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:45.815274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc688e-9cd9-4f44-bef1-c49a5c96e9c7 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:45.816182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc688e-9cd9-4f44-bef1-c49a5c96e9c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:45.816495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc688e-9cd9-4f44-bef1-c49a5c96e9c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:45.817975 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc688e-9cd9-4f44-bef1-c49a5c96e9c7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:45.857062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 373/757] 10.222.0.72 () {56 vars in 1149 bytes} [Mon May 16 18:35:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:45.858289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc688e-9cd9-4f44-bef1-c49a5c96e9c7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:45.870411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d0836-2b06-495d-8c52-9e32f5b6bba2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:45.916818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77644a-c87d-423f-b55d-0d672c7fdb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:45.918822 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77644a-c87d-423f-b55d-0d672c7fdb90 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:45.919492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77644a-c87d-423f-b55d-0d672c7fdb90 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:45.921477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77644a-c87d-423f-b55d-0d672c7fdb90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:45.936061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77644a-c87d-423f-b55d-0d672c7fdb90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:45.937760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77644a-c87d-423f-b55d-0d672c7fdb90 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-0a77644a-c87d-423f-b55d-0d672c7fdb90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:45.953314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:45.954225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:45.955114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:45.955114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:45.955114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:45.955114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:45.955114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:45.955114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:45.955114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:45.955114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:45.957007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 385/758] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:45.958405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51125c4-8437-4668-a221-e06da10767fd None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:45.958842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51125c4-8437-4668-a221-e06da10767fd None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:45.959277 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51125c4-8437-4668-a221-e06da10767fd None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:45.960949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 386/759] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:45.963632 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51125c4-8437-4668-a221-e06da10767fd None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:46.003620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc688e-9cd9-4f44-bef1-c49a5c96e9c7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:46.047931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276de7a-7545-485e-ba72-cde54080f99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:46.048840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276de7a-7545-485e-ba72-cde54080f99e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:46.049278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276de7a-7545-485e-ba72-cde54080f99e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:46.049729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276de7a-7545-485e-ba72-cde54080f99e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:46.079242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51125c4-8437-4668-a221-e06da10767fd None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:46.114567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3e957-431a-4b44-86f6-097861f16975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:46.115322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3e957-431a-4b44-86f6-097861f16975 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:46.115940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3e957-431a-4b44-86f6-097861f16975 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:46.115940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3e957-431a-4b44-86f6-097861f16975 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:46.116744 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3e957-431a-4b44-86f6-097861f16975 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:46.117084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3e957-431a-4b44-86f6-097861f16975 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:46.118642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3e957-431a-4b44-86f6-097861f16975 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:46.132592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 387/760] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:46.133803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bfcce-e0d4-4be4-909d-6f16d1b29013 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:46.134003 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bfcce-e0d4-4be4-909d-6f16d1b29013 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:46.134365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bfcce-e0d4-4be4-909d-6f16d1b29013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:46.135276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276de7a-7545-485e-ba72-cde54080f99e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:46.136933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276de7a-7545-485e-ba72-cde54080f99e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:46.154865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-622bfcce-e0d4-4be4-909d-6f16d1b29013 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:46.156246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-622bfcce-e0d4-4be4-909d-6f16d1b29013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:46.246878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 388/761] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:35:46.247488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bfcce-e0d4-4be4-909d-6f16d1b29013 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:46.251865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 374/762] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:35:46.264747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276de7a-7545-485e-ba72-cde54080f99e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:46.368160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bfcce-e0d4-4be4-909d-6f16d1b29013 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:46.381838 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276de7a-7545-485e-ba72-cde54080f99e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:46.411201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4765f-ad2e-4605-83cc-096a988a8eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:46.412718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4765f-ad2e-4605-83cc-096a988a8eb7 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:46.413005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4765f-ad2e-4605-83cc-096a988a8eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:46.413283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4765f-ad2e-4605-83cc-096a988a8eb7 None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/cc09bfcc0d8c4d20a156b3b08ffafa34/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:46.416894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4765f-ad2e-4605-83cc-096a988a8eb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=cc09bfcc0d8c4d20a156b3b08ffafa34, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:46.418949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4765f-ad2e-4605-83cc-096a988a8eb7 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:46.422871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422186b-c8b2-43e2-91f7-ace6fe34e032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:46.424301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422186b-c8b2-43e2-91f7-ace6fe34e032 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:46.424679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422186b-c8b2-43e2-91f7-ace6fe34e032 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:46.425061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422186b-c8b2-43e2-91f7-ace6fe34e032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:46.437263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 389/763] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:35:46 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/cc09bfcc0d8c4d20a156b3b08ffafa34/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:35:46.438342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4765f-ad2e-4605-83cc-096a988a8eb7 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:46.447013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422186b-c8b2-43e2-91f7-ace6fe34e032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:46.449583 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422186b-c8b2-43e2-91f7-ace6fe34e032 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-6422186b-c8b2-43e2-91f7-ace6fe34e032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:46.491672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:46.492807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:46.494250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:46.494250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:46.494250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:46.494250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:46.502879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 375/764] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:46.503476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422186b-c8b2-43e2-91f7-ace6fe34e032 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:46.643239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4765f-ad2e-4605-83cc-096a988a8eb7 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:46.658213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422186b-c8b2-43e2-91f7-ace6fe34e032 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:46.698109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fb128-6408-48a0-a859-048c34c456a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:46.699241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fb128-6408-48a0-a859-048c34c456a3 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:46.699746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fb128-6408-48a0-a859-048c34c456a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:46.700228 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fb128-6408-48a0-a859-048c34c456a3 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:46.701160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fb128-6408-48a0-a859-048c34c456a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:46.701749 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fb128-6408-48a0-a859-048c34c456a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:46.703507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fb128-6408-48a0-a859-048c34c456a3 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:46.708999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f957ab8-af7a-4a6c-baed-2e89cfb7ef7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:46.709811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f957ab8-af7a-4a6c-baed-2e89cfb7ef7c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:46.710088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f957ab8-af7a-4a6c-baed-2e89cfb7ef7c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:46.710360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f957ab8-af7a-4a6c-baed-2e89cfb7ef7c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:46.711019 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f957ab8-af7a-4a6c-baed-2e89cfb7ef7c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:46.713082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f957ab8-af7a-4a6c-baed-2e89cfb7ef7c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:46.719387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 376/765] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:46.724886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fb128-6408-48a0-a859-048c34c456a3 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-9f957ab8-af7a-4a6c-baed-2e89cfb7ef7c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:46.733458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:46.734413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:35:46.735243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:46.741168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 390/766] 10.222.0.72 () {56 vars in 1129 bytes} [Mon May 16 18:35:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:46.745614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f957ab8-af7a-4a6c-baed-2e89cfb7ef7c None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:46.859604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f957ab8-af7a-4a6c-baed-2e89cfb7ef7c None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:46.861929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fb128-6408-48a0-a859-048c34c456a3 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:46.894810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623ef46-534f-42f0-b984-4ead2c7d710b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:46.895908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623ef46-534f-42f0-b984-4ead2c7d710b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:46.896407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623ef46-534f-42f0-b984-4ead2c7d710b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:46.896885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623ef46-534f-42f0-b984-4ead2c7d710b None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:46.897878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623ef46-534f-42f0-b984-4ead2c7d710b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:46.898389 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623ef46-534f-42f0-b984-4ead2c7d710b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:46.900733 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623ef46-534f-42f0-b984-4ead2c7d710b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:46.907814 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c02f3-4011-4a2e-a59e-43f09528808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:46.908621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c02f3-4011-4a2e-a59e-43f09528808d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:46.909002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c02f3-4011-4a2e-a59e-43f09528808d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:46.909183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c02f3-4011-4a2e-a59e-43f09528808d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:46.909594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 391/767] 10.222.0.72 () {56 vars in 1124 bytes} [Mon May 16 18:35:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:46.911139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a5bc-9eaa-45e5-9eff-1d9e540369db None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:46.911634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a5bc-9eaa-45e5-9eff-1d9e540369db None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:46.912150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a5bc-9eaa-45e5-9eff-1d9e540369db None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:46.913948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 392/768] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:46.914846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a5bc-9eaa-45e5-9eff-1d9e540369db None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:46.920296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c02f3-4011-4a2e-a59e-43f09528808d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:46.921990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c02f3-4011-4a2e-a59e-43f09528808d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-ce7c02f3-4011-4a2e-a59e-43f09528808d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:46.940297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:46.941167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:46.942079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:46.942079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:46.942079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:46.942079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:46.942079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:46.942079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:46.942079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:46.942079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:46.944577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 377/769] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:46.946193 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8204-3395-4eab-a1c8-61bc136aa2a1 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:46.946685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8204-3395-4eab-a1c8-61bc136aa2a1 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:46.947704 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8204-3395-4eab-a1c8-61bc136aa2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:46.966376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-bc2a8204-3395-4eab-a1c8-61bc136aa2a1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:46.967955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-bc2a8204-3395-4eab-a1c8-61bc136aa2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:47.035778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 378/770] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:35:47.037077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a8204-3395-4eab-a1c8-61bc136aa2a1 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:47.062392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a5bc-9eaa-45e5-9eff-1d9e540369db None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:47.102298 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf3a0a-9a43-44d7-be69-5971a01aaf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:47.104141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf3a0a-9a43-44d7-be69-5971a01aaf89 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:47.104659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf3a0a-9a43-44d7-be69-5971a01aaf89 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:47.105186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf3a0a-9a43-44d7-be69-5971a01aaf89 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:47.106152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf3a0a-9a43-44d7-be69-5971a01aaf89 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:47.106678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf3a0a-9a43-44d7-be69-5971a01aaf89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:47.108304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf3a0a-9a43-44d7-be69-5971a01aaf89 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:47.115031 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 393/771] 10.222.0.72 () {56 vars in 1124 bytes} [Mon May 16 18:35:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:47.116131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf3a0a-9a43-44d7-be69-5971a01aaf89 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:47.164422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a8204-3395-4eab-a1c8-61bc136aa2a1 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:47.200002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93ef4b-6453-43ac-a535-b40cbb06969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:47.201086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93ef4b-6453-43ac-a535-b40cbb06969c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:47.201631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93ef4b-6453-43ac-a535-b40cbb06969c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:47.202135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93ef4b-6453-43ac-a535-b40cbb06969c None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:47.203131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93ef4b-6453-43ac-a535-b40cbb06969c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:47.203863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93ef4b-6453-43ac-a535-b40cbb06969c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:47.205618 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93ef4b-6453-43ac-a535-b40cbb06969c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:47.218750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 379/772] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:47.219937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93ef4b-6453-43ac-a535-b40cbb06969c None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:47.229736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf3a0a-9a43-44d7-be69-5971a01aaf89 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:47.271534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998286e6-1af1-47de-9e42-2c8f55f6e25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:47.272765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998286e6-1af1-47de-9e42-2c8f55f6e25a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:47.273302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998286e6-1af1-47de-9e42-2c8f55f6e25a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:47.273779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998286e6-1af1-47de-9e42-2c8f55f6e25a None admin] PATH_INFO: `/v3/services/network` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:47.274649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998286e6-1af1-47de-9e42-2c8f55f6e25a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:47.276493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998286e6-1af1-47de-9e42-2c8f55f6e25a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-998286e6-1af1-47de-9e42-2c8f55f6e25a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:47.288613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:47.289610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:35:47.290434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:47.297963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 394/773] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:47 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:47.299097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998286e6-1af1-47de-9e42-2c8f55f6e25a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:47.330237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93ef4b-6453-43ac-a535-b40cbb06969c None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:47.373030 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f76189-cda9-45f0-943b-95491fe37172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:47.373701 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f76189-cda9-45f0-943b-95491fe37172 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:47.373985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f76189-cda9-45f0-943b-95491fe37172 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:47.374264 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f76189-cda9-45f0-943b-95491fe37172 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:47.375065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f76189-cda9-45f0-943b-95491fe37172 None admin] RBAC: Adding query filter params (interface=public, service_id=c3ce86bae86c4366aec069aaa2153eed, region_id=RegionOne) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:47.375377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f76189-cda9-45f0-943b-95491fe37172 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:47.377228 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f76189-cda9-45f0-943b-95491fe37172 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:47.388047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 380/774] 10.222.0.72 () {56 vars in 1251 bytes} [Mon May 16 18:35:47 2022] GET /identity/v3/endpoints?service_id=c3ce86bae86c4366aec069aaa2153eed&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:47.388967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f76189-cda9-45f0-943b-95491fe37172 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:47.408774 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998286e6-1af1-47de-9e42-2c8f55f6e25a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:47.442559 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc329-f0e4-4cc5-8f25-6d675ef4e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:47.443496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc329-f0e4-4cc5-8f25-6d675ef4e47e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:47.443809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc329-f0e4-4cc5-8f25-6d675ef4e47e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:47.444106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc329-f0e4-4cc5-8f25-6d675ef4e47e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:47.444941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dc329-f0e4-4cc5-8f25-6d675ef4e47e None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=213dd48e9a5d46dda298caf8cbffce9e) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:47.445246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dc329-f0e4-4cc5-8f25-6d675ef4e47e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:47.447493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dc329-f0e4-4cc5-8f25-6d675ef4e47e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:47.463975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 395/775] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:47 2022] GET /identity/v3/role_assignments?user.id=213dd48e9a5d46dda298caf8cbffce9e&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:47.465375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc329-f0e4-4cc5-8f25-6d675ef4e47e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:47.543415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f76189-cda9-45f0-943b-95491fe37172 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:47.618342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696296b-77bf-4a8c-ad70-c0c047db068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:47.620742 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696296b-77bf-4a8c-ad70-c0c047db068b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:47.621264 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696296b-77bf-4a8c-ad70-c0c047db068b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:47.626615 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696296b-77bf-4a8c-ad70-c0c047db068b None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:47.627684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696296b-77bf-4a8c-ad70-c0c047db068b None admin] RBAC: Adding query filter params (name=network) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:47.628229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696296b-77bf-4a8c-ad70-c0c047db068b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:47.629862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696296b-77bf-4a8c-ad70-c0c047db068b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:47.643662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 381/776] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:35:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:47.648835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696296b-77bf-4a8c-ad70-c0c047db068b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:47.692159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc329-f0e4-4cc5-8f25-6d675ef4e47e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:47.743319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac4269-9052-40a9-b1c9-fca4d8541077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:47.744416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac4269-9052-40a9-b1c9-fca4d8541077 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:47.744925 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac4269-9052-40a9-b1c9-fca4d8541077 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:47.745407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac4269-9052-40a9-b1c9-fca4d8541077 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:47.746293 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac4269-9052-40a9-b1c9-fca4d8541077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:47.747904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac4269-9052-40a9-b1c9-fca4d8541077 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:47.760234 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 396/777] 10.222.0.72 () {56 vars in 1087 bytes} [Mon May 16 18:35:47 2022] GET /identity/v3/services => generated 772 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:47.761948 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696296b-77bf-4a8c-ad70-c0c047db068b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:47.815910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033b65d-db00-4116-ba9c-822ce57beb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:47.816612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033b65d-db00-4116-ba9c-822ce57beb04 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:47.816893 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033b65d-db00-4116-ba9c-822ce57beb04 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:47.817171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033b65d-db00-4116-ba9c-822ce57beb04 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:47.817910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033b65d-db00-4116-ba9c-822ce57beb04 None admin] RBAC: Adding query filter params (type=network) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:47.818216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033b65d-db00-4116-ba9c-822ce57beb04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:47.819655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033b65d-db00-4116-ba9c-822ce57beb04 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:47.826547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 382/778] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:35:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:47.832205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac4269-9052-40a9-b1c9-fca4d8541077 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:47.974821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac4269-9052-40a9-b1c9-fca4d8541077 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:48.022561 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e88033-b95a-478f-bc75-28dfde1ee1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:48.023292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88033-b95a-478f-bc75-28dfde1ee1e7 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:48.023572 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88033-b95a-478f-bc75-28dfde1ee1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:48.023872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88033-b95a-478f-bc75-28dfde1ee1e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:48.024726 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e88033-b95a-478f-bc75-28dfde1ee1e7 None admin] RBAC: Adding query filter params (interface=public, service_id=fda0ea6704914c1aa87c77b65b729464, region_id=RegionOne) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:48.025077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e88033-b95a-478f-bc75-28dfde1ee1e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:48.026468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e88033-b95a-478f-bc75-28dfde1ee1e7 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:48.038488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 397/779] 10.222.0.72 () {56 vars in 1251 bytes} [Mon May 16 18:35:47 2022] GET /identity/v3/endpoints?service_id=fda0ea6704914c1aa87c77b65b729464&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:48.044512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033b65d-db00-4116-ba9c-822ce57beb04 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:48.105314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71945b95-795b-4c13-bb6e-6232d7e2c672 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:48.105637 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71945b95-795b-4c13-bb6e-6232d7e2c672 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:48.106033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71945b95-795b-4c13-bb6e-6232d7e2c672 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:48.108320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 398/780] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:48.113714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b471-9608-4315-bf9b-bc01df0b95f6 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:48.114241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b471-9608-4315-bf9b-bc01df0b95f6 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:48.114722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b471-9608-4315-bf9b-bc01df0b95f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:48.133423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-78a1b471-9608-4315-bf9b-bc01df0b95f6 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:48.134666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-78a1b471-9608-4315-bf9b-bc01df0b95f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:48.154668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033b65d-db00-4116-ba9c-822ce57beb04 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:48.197355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885f8ed-669b-4eab-87da-a64adfc32a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:48.197927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885f8ed-669b-4eab-87da-a64adfc32a92 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:48.198212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885f8ed-669b-4eab-87da-a64adfc32a92 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:48.203740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885f8ed-669b-4eab-87da-a64adfc32a92 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:48.203740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885f8ed-669b-4eab-87da-a64adfc32a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:48.203740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885f8ed-669b-4eab-87da-a64adfc32a92 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:48.212924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 383/781] 10.222.0.72 () {56 vars in 1087 bytes} [Mon May 16 18:35:48 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:48.233296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 399/782] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:35:48.268634 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885f8ed-669b-4eab-87da-a64adfc32a92 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:48.405929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885f8ed-669b-4eab-87da-a64adfc32a92 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:48.445102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57815cf3-005b-4f13-a286-bee03f385806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:48.446010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815cf3-005b-4f13-a286-bee03f385806 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:48.446295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815cf3-005b-4f13-a286-bee03f385806 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:48.446573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57815cf3-005b-4f13-a286-bee03f385806 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:48.461358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57815cf3-005b-4f13-a286-bee03f385806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-57815cf3-005b-4f13-a286-bee03f385806 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:48.469577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:48.470489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:48.471334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 384/783] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:48.478850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b471-9608-4315-bf9b-bc01df0b95f6 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:48.583044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b471-9608-4315-bf9b-bc01df0b95f6 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:48.618373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92424c9e-62d0-4843-a34d-5457245000e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:48.619647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92424c9e-62d0-4843-a34d-5457245000e5 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:48.619999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92424c9e-62d0-4843-a34d-5457245000e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:48.620274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92424c9e-62d0-4843-a34d-5457245000e5 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:48.621085 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92424c9e-62d0-4843-a34d-5457245000e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:48.621392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92424c9e-62d0-4843-a34d-5457245000e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:48.622763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92424c9e-62d0-4843-a34d-5457245000e5 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:48.631535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 400/784] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:48.637113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57815cf3-005b-4f13-a286-bee03f385806 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:48.751872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57815cf3-005b-4f13-a286-bee03f385806 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:48.786427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372ab75-a318-47b7-8ac2-9e3a795fe2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:48.787234 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ab75-a318-47b7-8ac2-9e3a795fe2d6 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:48.787517 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ab75-a318-47b7-8ac2-9e3a795fe2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:48.787899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ab75-a318-47b7-8ac2-9e3a795fe2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:48.799362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372ab75-a318-47b7-8ac2-9e3a795fe2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:48.800856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372ab75-a318-47b7-8ac2-9e3a795fe2d6 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-4372ab75-a318-47b7-8ac2-9e3a795fe2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:48.819081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:48.821154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:48.823843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:48.823843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:48.823843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:48.823843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:48.823843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 385/785] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:48.834409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92424c9e-62d0-4843-a34d-5457245000e5 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:48.982763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92424c9e-62d0-4843-a34d-5457245000e5 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:49.026487 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b05d8-2cef-4b3a-af0f-9674a25a5a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:49.027098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b05d8-2cef-4b3a-af0f-9674a25a5a0a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:49.027380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b05d8-2cef-4b3a-af0f-9674a25a5a0a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:49.027756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b05d8-2cef-4b3a-af0f-9674a25a5a0a None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:49.028552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b05d8-2cef-4b3a-af0f-9674a25a5a0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:49.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b05d8-2cef-4b3a-af0f-9674a25a5a0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:49.033929 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b05d8-2cef-4b3a-af0f-9674a25a5a0a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:49.055881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 401/786] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:49.063261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372ab75-a318-47b7-8ac2-9e3a795fe2d6 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:49.173076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372ab75-a318-47b7-8ac2-9e3a795fe2d6 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:49.210123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51945e20-ba58-41da-877d-5a9945c924bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:49.211140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51945e20-ba58-41da-877d-5a9945c924bd None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:49.211569 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51945e20-ba58-41da-877d-5a9945c924bd None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:49.211888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51945e20-ba58-41da-877d-5a9945c924bd None admin] PATH_INFO: `/v3/users/swift` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:49.222659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51945e20-ba58-41da-877d-5a9945c924bd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:49.224150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51945e20-ba58-41da-877d-5a9945c924bd None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-51945e20-ba58-41da-877d-5a9945c924bd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:49.242965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:49.244040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:49.244999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:49.244999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:49.244999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:49.244999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:49.244999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:49.244999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:49.244999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:49.244999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:49.244999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:49.244999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:49.245645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 386/787] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:49.254154 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b05d8-2cef-4b3a-af0f-9674a25a5a0a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:49.344553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bf417-7b63-4fe7-9a3e-574e2b8a9bda None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:49.344553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bf417-7b63-4fe7-9a3e-574e2b8a9bda None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:49.344553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bf417-7b63-4fe7-9a3e-574e2b8a9bda None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:49.346185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 387/788] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:49.353159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e9e91-f019-416c-beac-d6eda5422642 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:49.353574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e9e91-f019-416c-beac-d6eda5422642 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:49.354063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e9e91-f019-416c-beac-d6eda5422642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:49.392850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-756e9e91-f019-416c-beac-d6eda5422642 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:49.394371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-756e9e91-f019-416c-beac-d6eda5422642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:49.411108 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b05d8-2cef-4b3a-af0f-9674a25a5a0a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:49.464164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6df4c-1942-4dfe-9459-ff369592060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:49.465118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6df4c-1942-4dfe-9459-ff369592060c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:49.465552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6df4c-1942-4dfe-9459-ff369592060c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:49.465974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6df4c-1942-4dfe-9459-ff369592060c None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:49.467005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6df4c-1942-4dfe-9459-ff369592060c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:49.467486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6df4c-1942-4dfe-9459-ff369592060c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:49.469939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6df4c-1942-4dfe-9459-ff369592060c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:49.490238 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 402/789] 10.222.0.72 () {56 vars in 1135 bytes} [Mon May 16 18:35:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:49.496535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6df4c-1942-4dfe-9459-ff369592060c None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:49.551950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 388/790] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:35:49.589152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e9e91-f019-416c-beac-d6eda5422642 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:49.628140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6df4c-1942-4dfe-9459-ff369592060c None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:49.672324 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c18dd-67e4-413e-8f73-2a8191c833c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:49.673858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c18dd-67e4-413e-8f73-2a8191c833c7 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:49.674351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c18dd-67e4-413e-8f73-2a8191c833c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:49.674873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c18dd-67e4-413e-8f73-2a8191c833c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:49.686712 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c18dd-67e4-413e-8f73-2a8191c833c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:49.688540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c18dd-67e4-413e-8f73-2a8191c833c7 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-170c18dd-67e4-413e-8f73-2a8191c833c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:49.716320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:49.718454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:49.719375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:49.719375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:49.719375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:49.719375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:49.722591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 403/791] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:49.728547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c18dd-67e4-413e-8f73-2a8191c833c7 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:49.760746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e9e91-f019-416c-beac-d6eda5422642 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:49.819559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501b42a-9521-4525-8e2f-2816e114f411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:49.819559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501b42a-9521-4525-8e2f-2816e114f411 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:49.819559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501b42a-9521-4525-8e2f-2816e114f411 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:49.819559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501b42a-9521-4525-8e2f-2816e114f411 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:49.841989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501b42a-9521-4525-8e2f-2816e114f411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-1501b42a-9521-4525-8e2f-2816e114f411 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:49.851469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:49.852491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:49.854025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:49.854654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 389/792] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:49.864965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501b42a-9521-4525-8e2f-2816e114f411 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:49.879863 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c18dd-67e4-413e-8f73-2a8191c833c7 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:49.926809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6486b9e-7f15-4af5-90c3-1e85516fdcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:49.933810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6486b9e-7f15-4af5-90c3-1e85516fdcdb None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:49.934336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6486b9e-7f15-4af5-90c3-1e85516fdcdb None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:49.934807 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6486b9e-7f15-4af5-90c3-1e85516fdcdb None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:49.935789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6486b9e-7f15-4af5-90c3-1e85516fdcdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:49.936421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6486b9e-7f15-4af5-90c3-1e85516fdcdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:49.938072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6486b9e-7f15-4af5-90c3-1e85516fdcdb None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:49.956150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 404/793] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:49.958091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6486b9e-7f15-4af5-90c3-1e85516fdcdb None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:50.066943 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6486b9e-7f15-4af5-90c3-1e85516fdcdb None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:50.107077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afd6c4-f407-442b-baf1-87e98cd3e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:50.108286 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afd6c4-f407-442b-baf1-87e98cd3e4db None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:50.109221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afd6c4-f407-442b-baf1-87e98cd3e4db None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:50.109821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afd6c4-f407-442b-baf1-87e98cd3e4db None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:50.117227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afd6c4-f407-442b-baf1-87e98cd3e4db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:50.119530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afd6c4-f407-442b-baf1-87e98cd3e4db None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-d6afd6c4-f407-442b-baf1-87e98cd3e4db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:50.136004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:50.136924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:50.137811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:50.137811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:50.137811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:50.137811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:50.137811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:50.137811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:50.137811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:50.137811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:50.140835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 405/794] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:50.146640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afd6c4-f407-442b-baf1-87e98cd3e4db None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:50.173671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501b42a-9521-4525-8e2f-2816e114f411 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:50.257307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b9c46-861c-4352-b839-b0122a59b3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:50.257983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b9c46-861c-4352-b839-b0122a59b3f5 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:50.258268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b9c46-861c-4352-b839-b0122a59b3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:50.258546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b9c46-861c-4352-b839-b0122a59b3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:50.259026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afd6c4-f407-442b-baf1-87e98cd3e4db None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:50.259329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b9c46-861c-4352-b839-b0122a59b3f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:50.259639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b9c46-861c-4352-b839-b0122a59b3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:50.261023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b9c46-861c-4352-b839-b0122a59b3f5 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:50.279257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 390/795] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:50.284262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b9c46-861c-4352-b839-b0122a59b3f5 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:50.298161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6208-a689-4450-9546-f6f09d1e1584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:50.299202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6208-a689-4450-9546-f6f09d1e1584 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:50.299857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6208-a689-4450-9546-f6f09d1e1584 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:50.300327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6208-a689-4450-9546-f6f09d1e1584 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:50.301337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc6208-a689-4450-9546-f6f09d1e1584 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:50.302176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc6208-a689-4450-9546-f6f09d1e1584 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:50.303997 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc6208-a689-4450-9546-f6f09d1e1584 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:50.318502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 406/796] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:50.325420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6208-a689-4450-9546-f6f09d1e1584 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:50.436550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6208-a689-4450-9546-f6f09d1e1584 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:50.478581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfdbde-3a7c-4858-ad44-184c3816881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:50.479922 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfdbde-3a7c-4858-ad44-184c3816881e None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:50.480404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfdbde-3a7c-4858-ad44-184c3816881e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:50.481923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfdbde-3a7c-4858-ad44-184c3816881e None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/55231d7b40cb4479b9a6580a0f0b7cb0/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:50.484385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfdbde-3a7c-4858-ad44-184c3816881e None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=55231d7b40cb4479b9a6580a0f0b7cb0, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:50.486027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfdbde-3a7c-4858-ad44-184c3816881e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:50.519002 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 407/797] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:35:50 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/55231d7b40cb4479b9a6580a0f0b7cb0/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:35:50.519742 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b9c46-861c-4352-b839-b0122a59b3f5 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:50.563700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56058992-ac02-41d4-a311-2245a4c3641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:50.564592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56058992-ac02-41d4-a311-2245a4c3641f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:50.564884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56058992-ac02-41d4-a311-2245a4c3641f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:50.565163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56058992-ac02-41d4-a311-2245a4c3641f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:50.580525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56058992-ac02-41d4-a311-2245a4c3641f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:50.582006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56058992-ac02-41d4-a311-2245a4c3641f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-56058992-ac02-41d4-a311-2245a4c3641f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:50.612071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:50.613108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:50.613990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:50.613990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:50.613990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:50.613990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:50.613990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 391/798] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:50.619596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfdbde-3a7c-4858-ad44-184c3816881e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:50.627144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27abfc-008b-4f39-b9e9-6e8a54834120 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:50.627458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27abfc-008b-4f39-b9e9-6e8a54834120 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:50.627790 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27abfc-008b-4f39-b9e9-6e8a54834120 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:50.630463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 392/799] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:50.639292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0880-a6a8-4538-a5e8-34240be3e496 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:50.639292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0880-a6a8-4538-a5e8-34240be3e496 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:50.639292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0880-a6a8-4538-a5e8-34240be3e496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:50.674566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-2ffd0880-a6a8-4538-a5e8-34240be3e496 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:50.675790 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2ffd0880-a6a8-4538-a5e8-34240be3e496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:50.769131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 393/800] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:35:50.770407 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5154a30-1ad0-4e9e-be62-165c7729409b None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:50.771019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5154a30-1ad0-4e9e-be62-165c7729409b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:50.771310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5154a30-1ad0-4e9e-be62-165c7729409b None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:50.773183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 394/801] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:50.773448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfdbde-3a7c-4858-ad44-184c3816881e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:50.778560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f67f-3cce-4cac-9de8-d2986c22d954 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:50.779072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f67f-3cce-4cac-9de8-d2986c22d954 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:50.779554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f67f-3cce-4cac-9de8-d2986c22d954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:50.799031 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1037f67f-3cce-4cac-9de8-d2986c22d954 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:50.800245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1037f67f-3cce-4cac-9de8-d2986c22d954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:50.821563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a3c41-c1ac-422b-a4e6-dac36202a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:50.822507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a3c41-c1ac-422b-a4e6-dac36202a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:50.823365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a3c41-c1ac-422b-a4e6-dac36202a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:50.823823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a3c41-c1ac-422b-a4e6-dac36202a6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:50.824974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a3c41-c1ac-422b-a4e6-dac36202a6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:50.825588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a3c41-c1ac-422b-a4e6-dac36202a6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:50.827803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a3c41-c1ac-422b-a4e6-dac36202a6a5 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:50.843359 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 408/802] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:50.844825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a3c41-c1ac-422b-a4e6-dac36202a6a5 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:50.874917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 395/803] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:35:50.876029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f67f-3cce-4cac-9de8-d2986c22d954 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:50.955247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a3c41-c1ac-422b-a4e6-dac36202a6a5 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:50.981305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f67f-3cce-4cac-9de8-d2986c22d954 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:50.990851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6295de-5ba5-4548-bd3d-fc23aae23aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:50.991728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6295de-5ba5-4548-bd3d-fc23aae23aa5 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:50.992012 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6295de-5ba5-4548-bd3d-fc23aae23aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:50.992334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6295de-5ba5-4548-bd3d-fc23aae23aa5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.003814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6295de-5ba5-4548-bd3d-fc23aae23aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-af6295de-5ba5-4548-bd3d-fc23aae23aa5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:51.012258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:51.013192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:51.014020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:51.014648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 409/804] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:51.015201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6295de-5ba5-4548-bd3d-fc23aae23aa5 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:51.019816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef876b2-1925-49eb-ab86-a69811dc2d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:51.019816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef876b2-1925-49eb-ab86-a69811dc2d97 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.019816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef876b2-1925-49eb-ab86-a69811dc2d97 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.019816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef876b2-1925-49eb-ab86-a69811dc2d97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.026738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef876b2-1925-49eb-ab86-a69811dc2d97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:51.028417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef876b2-1925-49eb-ab86-a69811dc2d97 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-6ef876b2-1925-49eb-ab86-a69811dc2d97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:51.043917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:51.045800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:51.048009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:51.048009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:51.048009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:51.048009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:51.048009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:51.048009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:51.048009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:51.048009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:51.048009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:35:51.048009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:51.055958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 396/805] 10.222.0.72 () {56 vars in 1093 bytes} [Mon May 16 18:35:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:51.055958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef876b2-1925-49eb-ab86-a69811dc2d97 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:51.120405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6295de-5ba5-4548-bd3d-fc23aae23aa5 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:51.152074 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef876b2-1925-49eb-ab86-a69811dc2d97 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:51.155609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61666511-4b39-421f-8c90-d99aeb820714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:51.156448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61666511-4b39-421f-8c90-d99aeb820714 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.156727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61666511-4b39-421f-8c90-d99aeb820714 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.156997 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61666511-4b39-421f-8c90-d99aeb820714 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.157648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61666511-4b39-421f-8c90-d99aeb820714 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:51.158998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61666511-4b39-421f-8c90-d99aeb820714 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-61666511-4b39-421f-8c90-d99aeb820714 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:51.171230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:51.172204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:51.173030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 410/806] 10.222.0.72 () {56 vars in 1129 bytes} [Mon May 16 18:35:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:51.173873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61666511-4b39-421f-8c90-d99aeb820714 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:51.189695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f15311-1bb6-4135-8338-da0f0c3d6b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:51.190699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15311-1bb6-4135-8338-da0f0c3d6b38 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.191054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15311-1bb6-4135-8338-da0f0c3d6b38 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.191422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15311-1bb6-4135-8338-da0f0c3d6b38 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.192285 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f15311-1bb6-4135-8338-da0f0c3d6b38 None admin] RBAC: Adding query filter params (name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:51.192594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f15311-1bb6-4135-8338-da0f0c3d6b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:51.193963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f15311-1bb6-4135-8338-da0f0c3d6b38 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:51.202459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 397/807] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:51.203808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05f81f-e0c4-4ba2-a83d-96bf1a1377c5 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.204095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05f81f-e0c4-4ba2-a83d-96bf1a1377c5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.204370 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05f81f-e0c4-4ba2-a83d-96bf1a1377c5 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.208052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 398/808] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:51.208052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05f81f-e0c4-4ba2-a83d-96bf1a1377c5 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:51.277977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61666511-4b39-421f-8c90-d99aeb820714 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:51.311482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beebeb-0e5e-4b2e-9e46-d834407f042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:51.312282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beebeb-0e5e-4b2e-9e46-d834407f042c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.312389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05f81f-e0c4-4ba2-a83d-96bf1a1377c5 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:51.312565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beebeb-0e5e-4b2e-9e46-d834407f042c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.312846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beebeb-0e5e-4b2e-9e46-d834407f042c None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.313698 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beebeb-0e5e-4b2e-9e46-d834407f042c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:51.314010 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beebeb-0e5e-4b2e-9e46-d834407f042c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:51.315441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beebeb-0e5e-4b2e-9e46-d834407f042c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:51.333109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 411/809] 10.222.0.72 () {56 vars in 1133 bytes} [Mon May 16 18:35:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:51.333944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beebeb-0e5e-4b2e-9e46-d834407f042c None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:51.354281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5858199-1988-4529-a76b-282b172c3441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:51.355266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858199-1988-4529-a76b-282b172c3441 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.355750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858199-1988-4529-a76b-282b172c3441 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.356202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858199-1988-4529-a76b-282b172c3441 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.357085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5858199-1988-4529-a76b-282b172c3441 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:51.357563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5858199-1988-4529-a76b-282b172c3441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:51.359125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5858199-1988-4529-a76b-282b172c3441 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:51.364019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 399/810] 10.222.0.72 () {56 vars in 1124 bytes} [Mon May 16 18:35:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:51.365421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e084818-6c0a-4ba1-a956-01ca920524bc None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.365710 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e084818-6c0a-4ba1-a956-01ca920524bc None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.365986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e084818-6c0a-4ba1-a956-01ca920524bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.383249 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1e084818-6c0a-4ba1-a956-01ca920524bc None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:51.385164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1e084818-6c0a-4ba1-a956-01ca920524bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:51.440033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beebeb-0e5e-4b2e-9e46-d834407f042c None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:51.452019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 400/811] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:35:51.453130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e084818-6c0a-4ba1-a956-01ca920524bc None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:51.486078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df53ae-f91e-47e7-8557-e09e39190f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:51.486884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df53ae-f91e-47e7-8557-e09e39190f46 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.487168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df53ae-f91e-47e7-8557-e09e39190f46 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.487444 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df53ae-f91e-47e7-8557-e09e39190f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.498028 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df53ae-f91e-47e7-8557-e09e39190f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:51.499469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df53ae-f91e-47e7-8557-e09e39190f46 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-b6df53ae-f91e-47e7-8557-e09e39190f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:51.517216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:51.518105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:51.518990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:51.518990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:51.518990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:51.518990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:51.523127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 412/812] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:51.523127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df53ae-f91e-47e7-8557-e09e39190f46 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:51.550178 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e084818-6c0a-4ba1-a956-01ca920524bc None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:51.583076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c811776-471f-484f-aed7-909be8dfa333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:51.583982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c811776-471f-484f-aed7-909be8dfa333 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.584417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c811776-471f-484f-aed7-909be8dfa333 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.584888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c811776-471f-484f-aed7-909be8dfa333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.621084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df53ae-f91e-47e7-8557-e09e39190f46 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:51.653642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c811776-471f-484f-aed7-909be8dfa333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:51.655084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c811776-471f-484f-aed7-909be8dfa333 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:51.655958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1f19e-7a57-447d-a92f-fa7107754cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:51.656619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f19e-7a57-447d-a92f-fa7107754cd0 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.656903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f19e-7a57-447d-a92f-fa7107754cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.657174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1f19e-7a57-447d-a92f-fa7107754cd0 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.657885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1f19e-7a57-447d-a92f-fa7107754cd0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:51.658189 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1f19e-7a57-447d-a92f-fa7107754cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:51.659526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1f19e-7a57-447d-a92f-fa7107754cd0 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:51.664304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 413/813] 10.222.0.72 () {56 vars in 1124 bytes} [Mon May 16 18:35:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:51.665083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1f19e-7a57-447d-a92f-fa7107754cd0 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:51.769332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 401/814] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:35:51.769332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c811776-471f-484f-aed7-909be8dfa333 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:51.769954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1f19e-7a57-447d-a92f-fa7107754cd0 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:51.800652 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a53aa-842a-450d-a951-7ba0d51d15ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:51.801411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a53aa-842a-450d-a951-7ba0d51d15ab None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.801690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a53aa-842a-450d-a951-7ba0d51d15ab None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.801961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a53aa-842a-450d-a951-7ba0d51d15ab None admin] PATH_INFO: `/v3/services/network` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.802619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a53aa-842a-450d-a951-7ba0d51d15ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:51.804133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a53aa-842a-450d-a951-7ba0d51d15ab None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-a61a53aa-842a-450d-a951-7ba0d51d15ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:51.816606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:51.817827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:51.818660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 414/815] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:51 2022] GET /identity/v3/services/network => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:51.819461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a53aa-842a-450d-a951-7ba0d51d15ab None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:51.872601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c811776-471f-484f-aed7-909be8dfa333 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:51.906225 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c9137-891d-4a7c-ab7d-16e3f82473bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:51.906984 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c9137-891d-4a7c-ab7d-16e3f82473bf None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.907342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c9137-891d-4a7c-ab7d-16e3f82473bf None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.907695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c9137-891d-4a7c-ab7d-16e3f82473bf None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.908514 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c9137-891d-4a7c-ab7d-16e3f82473bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:51.908829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c9137-891d-4a7c-ab7d-16e3f82473bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:51.910189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c9137-891d-4a7c-ab7d-16e3f82473bf None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:51.921270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 402/816] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:51.922092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c9137-891d-4a7c-ab7d-16e3f82473bf None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:51.928020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a53aa-842a-450d-a951-7ba0d51d15ab None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:51.964112 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2611f05-4be1-4224-9f85-b5fd854dd203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:51.964779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611f05-4be1-4224-9f85-b5fd854dd203 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:51.965065 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611f05-4be1-4224-9f85-b5fd854dd203 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:51.965342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611f05-4be1-4224-9f85-b5fd854dd203 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:51.966083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2611f05-4be1-4224-9f85-b5fd854dd203 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:51.967445 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2611f05-4be1-4224-9f85-b5fd854dd203 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:51.988138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 415/817] 10.222.0.72 () {60 vars in 1144 bytes} [Mon May 16 18:35:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:35:51.989011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2611f05-4be1-4224-9f85-b5fd854dd203 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:52.063312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c9137-891d-4a7c-ab7d-16e3f82473bf None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:52.101801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2611f05-4be1-4224-9f85-b5fd854dd203 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:52.109135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcec42b-552c-4617-b0cb-ba4aa8d3aa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:52.110855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec42b-552c-4617-b0cb-ba4aa8d3aa6d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:52.111298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec42b-552c-4617-b0cb-ba4aa8d3aa6d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:52.111770 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec42b-552c-4617-b0cb-ba4aa8d3aa6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:52.126682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcec42b-552c-4617-b0cb-ba4aa8d3aa6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:52.129198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcec42b-552c-4617-b0cb-ba4aa8d3aa6d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:52.138350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640f8dd-3d92-4c6e-9596-f4ee1c6e7e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:52.139129 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640f8dd-3d92-4c6e-9596-f4ee1c6e7e3b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:52.139479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640f8dd-3d92-4c6e-9596-f4ee1c6e7e3b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:52.139865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640f8dd-3d92-4c6e-9596-f4ee1c6e7e3b None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:52.140666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640f8dd-3d92-4c6e-9596-f4ee1c6e7e3b None admin] RBAC: Adding query filter params (name=network) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:52.141060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640f8dd-3d92-4c6e-9596-f4ee1c6e7e3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:52.142510 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640f8dd-3d92-4c6e-9596-f4ee1c6e7e3b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:52.152456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 416/818] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:35:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:52.152456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640f8dd-3d92-4c6e-9596-f4ee1c6e7e3b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-5bcec42b-552c-4617-b0cb-ba4aa8d3aa6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:52.156276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:52.157150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:52.158049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:52.158049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:52.158049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:52.158049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:52.158049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 403/819] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:52.158866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcec42b-552c-4617-b0cb-ba4aa8d3aa6d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:52.277149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640f8dd-3d92-4c6e-9596-f4ee1c6e7e3b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:52.277501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcec42b-552c-4617-b0cb-ba4aa8d3aa6d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:52.313593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99eb22-bc65-48b6-ad23-3489681d845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:52.314753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99eb22-bc65-48b6-ad23-3489681d845a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:52.315340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99eb22-bc65-48b6-ad23-3489681d845a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:52.315848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99eb22-bc65-48b6-ad23-3489681d845a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:52.324038 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99eb22-bc65-48b6-ad23-3489681d845a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:52.326034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99eb22-bc65-48b6-ad23-3489681d845a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:52.328549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ce436-ed20-44aa-a8ac-3ec0ceec9d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:52.329843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce436-ed20-44aa-a8ac-3ec0ceec9d49 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:52.330248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce436-ed20-44aa-a8ac-3ec0ceec9d49 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:52.330624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce436-ed20-44aa-a8ac-3ec0ceec9d49 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:52.331451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ce436-ed20-44aa-a8ac-3ec0ceec9d49 None admin] RBAC: Adding query filter params (type=network) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:52.332013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ce436-ed20-44aa-a8ac-3ec0ceec9d49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:52.333478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ce436-ed20-44aa-a8ac-3ec0ceec9d49 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:52.339222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 404/820] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:35:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:52.344310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ce436-ed20-44aa-a8ac-3ec0ceec9d49 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-ed99eb22-bc65-48b6-ad23-3489681d845a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:52.347799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:52.348715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:52.349648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:52.349648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:52.349648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:52.349648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:52.349648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:52.349648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:52.349648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:52.349648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:52.349648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:35:52.349648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:52.352369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 417/821] 10.222.0.72 () {56 vars in 1117 bytes} [Mon May 16 18:35:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:52.354118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99eb22-bc65-48b6-ad23-3489681d845a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:52.455632 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99eb22-bc65-48b6-ad23-3489681d845a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:52.469888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ce436-ed20-44aa-a8ac-3ec0ceec9d49 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:52.498652 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d02e5-fe8e-4263-8b7a-7811813336a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:52.499569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d02e5-fe8e-4263-8b7a-7811813336a2 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:52.499959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d02e5-fe8e-4263-8b7a-7811813336a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:52.500312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d02e5-fe8e-4263-8b7a-7811813336a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:52.501479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d02e5-fe8e-4263-8b7a-7811813336a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:52.503531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d02e5-fe8e-4263-8b7a-7811813336a2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:52.512198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543a709-5040-4bf6-abae-1d3b915b1a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:52.513174 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543a709-5040-4bf6-abae-1d3b915b1a93 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:52.513663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543a709-5040-4bf6-abae-1d3b915b1a93 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:52.514381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543a709-5040-4bf6-abae-1d3b915b1a93 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:52.515046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543a709-5040-4bf6-abae-1d3b915b1a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:52.515486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543a709-5040-4bf6-abae-1d3b915b1a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:52.516965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543a709-5040-4bf6-abae-1d3b915b1a93 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:52.528429 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 418/822] 10.222.0.72 () {60 vars in 1144 bytes} [Mon May 16 18:35:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:35:52.529713 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d02e5-fe8e-4263-8b7a-7811813336a2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:52.548519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 405/823] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:52.551811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543a709-5040-4bf6-abae-1d3b915b1a93 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:52.692329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d02e5-fe8e-4263-8b7a-7811813336a2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:52.714808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543a709-5040-4bf6-abae-1d3b915b1a93 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:52.733238 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be702469-dd5b-449c-b1df-0aa12ee6e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:52.734341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be702469-dd5b-449c-b1df-0aa12ee6e073 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:52.734919 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be702469-dd5b-449c-b1df-0aa12ee6e073 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:52.735389 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be702469-dd5b-449c-b1df-0aa12ee6e073 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:52.736758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be702469-dd5b-449c-b1df-0aa12ee6e073 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:52.737317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be702469-dd5b-449c-b1df-0aa12ee6e073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:52.739141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be702469-dd5b-449c-b1df-0aa12ee6e073 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:52.755083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da9ec-49ed-4347-8c85-b9c3919ec13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:52.755928 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da9ec-49ed-4347-8c85-b9c3919ec13b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:52.756214 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da9ec-49ed-4347-8c85-b9c3919ec13b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:52.756492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da9ec-49ed-4347-8c85-b9c3919ec13b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:52.762431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 419/824] 10.222.0.72 () {56 vars in 1149 bytes} [Mon May 16 18:35:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:52.767317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2da9ec-49ed-4347-8c85-b9c3919ec13b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:52.767317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2da9ec-49ed-4347-8c85-b9c3919ec13b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:52.768737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be702469-dd5b-449c-b1df-0aa12ee6e073 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-5a2da9ec-49ed-4347-8c85-b9c3919ec13b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:52.781258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:52.782581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:52.783474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:52.783474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:52.783474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:52.783474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:52.783474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:52.783474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:52.783474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:52.783474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:52.783474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 406/825] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:52.788537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da9ec-49ed-4347-8c85-b9c3919ec13b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:52.882946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be702469-dd5b-449c-b1df-0aa12ee6e073 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:52.893046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da9ec-49ed-4347-8c85-b9c3919ec13b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:52.919399 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5475f1-7874-4411-8068-358f9cc99fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:52.920637 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5475f1-7874-4411-8068-358f9cc99fda None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:52.921128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5475f1-7874-4411-8068-358f9cc99fda None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:52.921641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5475f1-7874-4411-8068-358f9cc99fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:52.933327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916ea28-3a29-45a2-a0c3-b7a8a2b3dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:52.934333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ea28-3a29-45a2-a0c3-b7a8a2b3dc5b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:52.934547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5475f1-7874-4411-8068-358f9cc99fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:52.934681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ea28-3a29-45a2-a0c3-b7a8a2b3dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:52.934894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ea28-3a29-45a2-a0c3-b7a8a2b3dc5b None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:52.935734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916ea28-3a29-45a2-a0c3-b7a8a2b3dc5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:52.936045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916ea28-3a29-45a2-a0c3-b7a8a2b3dc5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:52.936148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5475f1-7874-4411-8068-358f9cc99fda None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:52.937475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916ea28-3a29-45a2-a0c3-b7a8a2b3dc5b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-fa5475f1-7874-4411-8068-358f9cc99fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:52.955187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:52.956151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:52.957036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:52.957036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:52.957036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:52.957036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:52.957254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 407/826] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:52.957808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3010-830f-48ad-a768-3a23042592ef None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:52.963750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3010-830f-48ad-a768-3a23042592ef None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:52.963750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a3010-830f-48ad-a768-3a23042592ef None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:52.963962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 420/828] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:52.963962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5475f1-7874-4411-8068-358f9cc99fda None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:52.964119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 408/828] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:52.964751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a3010-830f-48ad-a768-3a23042592ef None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:53.075582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5475f1-7874-4411-8068-358f9cc99fda None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:53.086426 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a3010-830f-48ad-a768-3a23042592ef None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:53.108772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08889d-a817-499f-b56f-26f1312b310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:53.109432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08889d-a817-499f-b56f-26f1312b310b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:53.109710 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08889d-a817-499f-b56f-26f1312b310b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:53.109988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08889d-a817-499f-b56f-26f1312b310b None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:53.110710 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08889d-a817-499f-b56f-26f1312b310b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:53.111015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08889d-a817-499f-b56f-26f1312b310b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:53.112390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08889d-a817-499f-b56f-26f1312b310b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:53.120252 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a9cda-508e-449b-916c-25c16f2c8254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:53.120905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9cda-508e-449b-916c-25c16f2c8254 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:53.121187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9cda-508e-449b-916c-25c16f2c8254 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:53.121460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9cda-508e-449b-916c-25c16f2c8254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:53.122287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a9cda-508e-449b-916c-25c16f2c8254 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=cc09bfcc0d8c4d20a156b3b08ffafa34) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:53.122594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a9cda-508e-449b-916c-25c16f2c8254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:53.128384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 421/829] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:53.128526 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a9cda-508e-449b-916c-25c16f2c8254 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:53.128619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a6cff-40a1-47c4-9cc0-0d74fbb3e068 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:53.128619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a6cff-40a1-47c4-9cc0-0d74fbb3e068 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:53.128619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a6cff-40a1-47c4-9cc0-0d74fbb3e068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:53.133614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 409/830] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:52 2022] GET /identity/v3/role_assignments?user.id=cc09bfcc0d8c4d20a156b3b08ffafa34&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=b104fd2e772843a0974990f965d8b589 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:53.143786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a9cda-508e-449b-916c-25c16f2c8254 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:53.151304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2a2a6cff-40a1-47c4-9cc0-0d74fbb3e068 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:53.152648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2a2a6cff-40a1-47c4-9cc0-0d74fbb3e068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:53.243953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 422/831] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:35:53.269507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a6cff-40a1-47c4-9cc0-0d74fbb3e068 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:53.277136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a9cda-508e-449b-916c-25c16f2c8254 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:53.324185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba87f5-f942-4741-950c-23d7dd3e33af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:53.325036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba87f5-f942-4741-950c-23d7dd3e33af None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:53.325326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba87f5-f942-4741-950c-23d7dd3e33af None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:53.325609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba87f5-f942-4741-950c-23d7dd3e33af None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:53.333320 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba87f5-f942-4741-950c-23d7dd3e33af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:53.334785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba87f5-f942-4741-950c-23d7dd3e33af None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-8eba87f5-f942-4741-950c-23d7dd3e33af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:53.355528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:53.356711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:53.357602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:53.357602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:53.357602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:53.357602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:53.357602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:53.357602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:53.357602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:53.357602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:53.357602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 410/832] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:53.362662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba87f5-f942-4741-950c-23d7dd3e33af None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:53.401167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a6cff-40a1-47c4-9cc0-0d74fbb3e068 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:53.441599 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b32c8e-b5b6-4bcf-83f9-da517630855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:53.442397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b32c8e-b5b6-4bcf-83f9-da517630855f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:53.442676 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b32c8e-b5b6-4bcf-83f9-da517630855f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:53.442945 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b32c8e-b5b6-4bcf-83f9-da517630855f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:53.453431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b32c8e-b5b6-4bcf-83f9-da517630855f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-b6b32c8e-b5b6-4bcf-83f9-da517630855f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:53.461308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:53.462963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:53.464915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 423/833] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:53.469451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b32c8e-b5b6-4bcf-83f9-da517630855f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:53.487277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba87f5-f942-4741-950c-23d7dd3e33af None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:53.531260 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c29b-57d8-4080-851a-5e5d576ac7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:53.532434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c29b-57d8-4080-851a-5e5d576ac7fa None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:53.532866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c29b-57d8-4080-851a-5e5d576ac7fa None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:53.533279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c29b-57d8-4080-851a-5e5d576ac7fa None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:53.534372 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87c29b-57d8-4080-851a-5e5d576ac7fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:53.534843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87c29b-57d8-4080-851a-5e5d576ac7fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:53.537227 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87c29b-57d8-4080-851a-5e5d576ac7fa None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:53.557916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 411/834] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:53.561068 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c29b-57d8-4080-851a-5e5d576ac7fa None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:53.572934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b32c8e-b5b6-4bcf-83f9-da517630855f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:53.606767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e42cb0-e57a-4a50-b146-635c73cc4677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:53.607830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e42cb0-e57a-4a50-b146-635c73cc4677 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:53.608313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e42cb0-e57a-4a50-b146-635c73cc4677 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:53.608803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e42cb0-e57a-4a50-b146-635c73cc4677 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:53.609753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e42cb0-e57a-4a50-b146-635c73cc4677 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:53.610253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e42cb0-e57a-4a50-b146-635c73cc4677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:53.611844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e42cb0-e57a-4a50-b146-635c73cc4677 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:53.620975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 424/835] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:35:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:53.626672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e42cb0-e57a-4a50-b146-635c73cc4677 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:53.675520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c29b-57d8-4080-851a-5e5d576ac7fa None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:53.716035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b945ed3-a9dc-4940-a512-fe0881cab155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:53.717727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b945ed3-a9dc-4940-a512-fe0881cab155 None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:53.718464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b945ed3-a9dc-4940-a512-fe0881cab155 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:53.719274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b945ed3-a9dc-4940-a512-fe0881cab155 None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/213dd48e9a5d46dda298caf8cbffce9e/roles/07ebf23e49074f6ca9b1f96878f4fa7b` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:53.739292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b945ed3-a9dc-4940-a512-fe0881cab155 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=213dd48e9a5d46dda298caf8cbffce9e, role_id=07ebf23e49074f6ca9b1f96878f4fa7b)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:53.741278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b945ed3-a9dc-4940-a512-fe0881cab155 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:53.747448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e42cb0-e57a-4a50-b146-635c73cc4677 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:53.767392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 412/836] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:35:53 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/213dd48e9a5d46dda298caf8cbffce9e/roles/07ebf23e49074f6ca9b1f96878f4fa7b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:35:53.802459 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec529b5-ba7e-4926-b37d-3b7586d0dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:53.803562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec529b5-ba7e-4926-b37d-3b7586d0dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:53.803980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec529b5-ba7e-4926-b37d-3b7586d0dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:53.804260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec529b5-ba7e-4926-b37d-3b7586d0dbb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:53.829467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec529b5-ba7e-4926-b37d-3b7586d0dbb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:53.831032 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec529b5-ba7e-4926-b37d-3b7586d0dbb9 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-6ec529b5-ba7e-4926-b37d-3b7586d0dbb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:53.856436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:53.857622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:53.858727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:53.858727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:53.858727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:53.858727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:53.863386 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 425/837] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:53.868247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b945ed3-a9dc-4940-a512-fe0881cab155 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:54.082941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b945ed3-a9dc-4940-a512-fe0881cab155 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:54.119453 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50847d-a326-494a-b892-7334ad5448e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:54.120216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50847d-a326-494a-b892-7334ad5448e1 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:54.120500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50847d-a326-494a-b892-7334ad5448e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:54.120779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50847d-a326-494a-b892-7334ad5448e1 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:54.121518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50847d-a326-494a-b892-7334ad5448e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:54.121827 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50847d-a326-494a-b892-7334ad5448e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:54.123211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50847d-a326-494a-b892-7334ad5448e1 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:54.139750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 413/838] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:54.144910 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec529b5-ba7e-4926-b37d-3b7586d0dbb9 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:54.269314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec529b5-ba7e-4926-b37d-3b7586d0dbb9 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:54.311536 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b1ef8-95b6-4087-a7b9-ab2ca224c7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:54.312765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b1ef8-95b6-4087-a7b9-ab2ca224c7ac None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:54.313230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b1ef8-95b6-4087-a7b9-ab2ca224c7ac None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:54.313683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b1ef8-95b6-4087-a7b9-ab2ca224c7ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:54.322253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b1ef8-95b6-4087-a7b9-ab2ca224c7ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:54.324142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b1ef8-95b6-4087-a7b9-ab2ca224c7ac None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-f91b1ef8-95b6-4087-a7b9-ab2ca224c7ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:54.340344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:54.341328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:54.342272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:54.342272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:54.342272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:54.342272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:54.342272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:54.342272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:54.342272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:54.342272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:54.342272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 18:35:54.342272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:54.344947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 426/839] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:35:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:54.355774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50847d-a326-494a-b892-7334ad5448e1 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:54.455608 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50847d-a326-494a-b892-7334ad5448e1 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:54.490820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2a98b-165f-4049-a2e4-114696ceb427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:54.491500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2a98b-165f-4049-a2e4-114696ceb427 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:54.491809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2a98b-165f-4049-a2e4-114696ceb427 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:54.492086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2a98b-165f-4049-a2e4-114696ceb427 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:54.492933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2a98b-165f-4049-a2e4-114696ceb427 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:54.493237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2a98b-165f-4049-a2e4-114696ceb427 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:54.494931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2a98b-165f-4049-a2e4-114696ceb427 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:54.513899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 414/840] 10.222.0.72 () {56 vars in 1135 bytes} [Mon May 16 18:35:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:54.519498 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b1ef8-95b6-4087-a7b9-ab2ca224c7ac None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:54.527103 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad08928-a248-4aea-b33b-7868daf86bc2 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:54.527396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad08928-a248-4aea-b33b-7868daf86bc2 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:54.527692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad08928-a248-4aea-b33b-7868daf86bc2 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:54.529255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 415/841] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:54.534108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136f58b-ee5c-4418-99c0-959069247cab None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:54.534401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136f58b-ee5c-4418-99c0-959069247cab None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:54.534688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136f58b-ee5c-4418-99c0-959069247cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:54.551886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4136f58b-ee5c-4418-99c0-959069247cab None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:54.553115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4136f58b-ee5c-4418-99c0-959069247cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:54.623218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 416/842] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:35:54.636206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b1ef8-95b6-4087-a7b9-ab2ca224c7ac None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:54.645107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136f58b-ee5c-4418-99c0-959069247cab None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:54.684187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85828f8d-5771-4165-8cef-82a59f87c9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:54.686003 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85828f8d-5771-4165-8cef-82a59f87c9fa None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:54.686496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85828f8d-5771-4165-8cef-82a59f87c9fa None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:54.687080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85828f8d-5771-4165-8cef-82a59f87c9fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:54.766566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85828f8d-5771-4165-8cef-82a59f87c9fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:54.767227 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136f58b-ee5c-4418-99c0-959069247cab None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:54.768714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85828f8d-5771-4165-8cef-82a59f87c9fa None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:54.809778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083c1ba-58cf-495e-bbbb-e32604893306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:54.810945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083c1ba-58cf-495e-bbbb-e32604893306 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:54.811231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083c1ba-58cf-495e-bbbb-e32604893306 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:54.811509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083c1ba-58cf-495e-bbbb-e32604893306 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:54.812225 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083c1ba-58cf-495e-bbbb-e32604893306 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:54.814244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083c1ba-58cf-495e-bbbb-e32604893306 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-8083c1ba-58cf-495e-bbbb-e32604893306 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:54.832694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:54.833732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:35:54.834567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:54.842915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 417/843] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:35:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:54.844446 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083c1ba-58cf-495e-bbbb-e32604893306 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:54.887864 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 427/844] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:35:54.890343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85828f8d-5771-4165-8cef-82a59f87c9fa None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:54.962206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083c1ba-58cf-495e-bbbb-e32604893306 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:55.004942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7b44d-a692-4e21-95c6-f41b3c602dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:55.005615 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7b44d-a692-4e21-95c6-f41b3c602dd6 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:55.005901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7b44d-a692-4e21-95c6-f41b3c602dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:55.006184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7b44d-a692-4e21-95c6-f41b3c602dd6 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:55.006901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7b44d-a692-4e21-95c6-f41b3c602dd6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:55.007209 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7b44d-a692-4e21-95c6-f41b3c602dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:55.007992 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85828f8d-5771-4165-8cef-82a59f87c9fa None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:55.008605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7b44d-a692-4e21-95c6-f41b3c602dd6 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:55.018327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 418/845] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:35:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:55.023743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7b44d-a692-4e21-95c6-f41b3c602dd6 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:55.056790 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ac25e-826b-4577-99f2-5d9e8ae91065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:55.057963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac25e-826b-4577-99f2-5d9e8ae91065 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:55.058583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac25e-826b-4577-99f2-5d9e8ae91065 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:55.059868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac25e-826b-4577-99f2-5d9e8ae91065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:55.073246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ac25e-826b-4577-99f2-5d9e8ae91065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:55.075332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ac25e-826b-4577-99f2-5d9e8ae91065 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-a88ac25e-826b-4577-99f2-5d9e8ae91065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:55.099894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:55.100827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:55.101709 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:55.101709 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:55.101709 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:55.101709 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:55.109866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 428/846] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:35:55.110402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ac25e-826b-4577-99f2-5d9e8ae91065 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:55.135605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7b44d-a692-4e21-95c6-f41b3c602dd6 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:55.172399 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465dea0-fb96-48a5-8ebb-7af0610fd919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:55.172920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465dea0-fb96-48a5-8ebb-7af0610fd919 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:55.173236 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465dea0-fb96-48a5-8ebb-7af0610fd919 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:55.173518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465dea0-fb96-48a5-8ebb-7af0610fd919 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:55.174246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465dea0-fb96-48a5-8ebb-7af0610fd919 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:55.174575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465dea0-fb96-48a5-8ebb-7af0610fd919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:55.176040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465dea0-fb96-48a5-8ebb-7af0610fd919 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:55.188052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 419/847] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:35:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:35:55.234298 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ac25e-826b-4577-99f2-5d9e8ae91065 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:55.276528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ca627-b6f9-4ae2-b2b0-a9c9d1e3034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:55.277660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ca627-b6f9-4ae2-b2b0-a9c9d1e3034c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:55.278164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ca627-b6f9-4ae2-b2b0-a9c9d1e3034c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:55.278656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ca627-b6f9-4ae2-b2b0-a9c9d1e3034c None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:55.279628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ca627-b6f9-4ae2-b2b0-a9c9d1e3034c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:55.280170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ca627-b6f9-4ae2-b2b0-a9c9d1e3034c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:55.281784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ca627-b6f9-4ae2-b2b0-a9c9d1e3034c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:55.295660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 429/848] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:55.301709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465dea0-fb96-48a5-8ebb-7af0610fd919 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:55.415334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465dea0-fb96-48a5-8ebb-7af0610fd919 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:55.451027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bfd8f-ae44-470f-b4cb-2574837111e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:55.452215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bfd8f-ae44-470f-b4cb-2574837111e4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:55.452709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bfd8f-ae44-470f-b4cb-2574837111e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:55.453186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bfd8f-ae44-470f-b4cb-2574837111e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:55.460143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bfd8f-ae44-470f-b4cb-2574837111e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:55.461886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bfd8f-ae44-470f-b4cb-2574837111e4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-9e9bfd8f-ae44-470f-b4cb-2574837111e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:55.477687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:55.479165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:55.480079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:55.480079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:55.480079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:55.480079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:55.480079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:55.480079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:55.480079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:55.480079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:55.482506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 420/849] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:55.488362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ca627-b6f9-4ae2-b2b0-a9c9d1e3034c None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:55.548722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7c65-172b-4c3a-a84e-7527ef7f6499 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:55.549095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7c65-172b-4c3a-a84e-7527ef7f6499 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:55.549282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7c65-172b-4c3a-a84e-7527ef7f6499 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:55.551978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 421/850] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:55.556552 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b909218-a305-4c41-8570-6fddc4cb9b00 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:55.556844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b909218-a305-4c41-8570-6fddc4cb9b00 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:55.557123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b909218-a305-4c41-8570-6fddc4cb9b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:55.573567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-2b909218-a305-4c41-8570-6fddc4cb9b00 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:55.574731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2b909218-a305-4c41-8570-6fddc4cb9b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:55.601177 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ca627-b6f9-4ae2-b2b0-a9c9d1e3034c None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:55.645791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b85f6-673a-40be-95ab-bb1955dc22bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:55.646862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b85f6-673a-40be-95ab-bb1955dc22bd None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:55.647329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b85f6-673a-40be-95ab-bb1955dc22bd None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:55.647822 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b85f6-673a-40be-95ab-bb1955dc22bd None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:55.648860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b85f6-673a-40be-95ab-bb1955dc22bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:55.649346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b85f6-673a-40be-95ab-bb1955dc22bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:55.651489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b85f6-673a-40be-95ab-bb1955dc22bd None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:55.651837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 422/851] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:35:55.664693 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 430/852] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:55.670213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b909218-a305-4c41-8570-6fddc4cb9b00 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:55.671322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b85f6-673a-40be-95ab-bb1955dc22bd None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:55.779406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b909218-a305-4c41-8570-6fddc4cb9b00 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:55.796639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b85f6-673a-40be-95ab-bb1955dc22bd None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:55.814020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bab9d-7945-4910-83b0-3ac4edd39e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:55.815028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bab9d-7945-4910-83b0-3ac4edd39e45 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:55.815302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bab9d-7945-4910-83b0-3ac4edd39e45 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:55.815682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bab9d-7945-4910-83b0-3ac4edd39e45 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:55.816448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bab9d-7945-4910-83b0-3ac4edd39e45 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:55.817890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bab9d-7945-4910-83b0-3ac4edd39e45 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-134bab9d-7945-4910-83b0-3ac4edd39e45 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:55.830988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:55.832014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:35:55.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:55.838107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 423/853] 10.222.0.72 () {56 vars in 1132 bytes} [Mon May 16 18:35:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:55.839829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bab9d-7945-4910-83b0-3ac4edd39e45 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:55.841798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dd1db-85cb-40d2-8162-9b51639662e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:55.842888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dd1db-85cb-40d2-8162-9b51639662e3 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:55.843611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dd1db-85cb-40d2-8162-9b51639662e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:55.844097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dd1db-85cb-40d2-8162-9b51639662e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:55.845103 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dd1db-85cb-40d2-8162-9b51639662e3 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=55231d7b40cb4479b9a6580a0f0b7cb0) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:55.845594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dd1db-85cb-40d2-8162-9b51639662e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:55.847220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dd1db-85cb-40d2-8162-9b51639662e3 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:55.859861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 431/854] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:55 2022] GET /identity/v3/role_assignments?user.id=55231d7b40cb4479b9a6580a0f0b7cb0&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=b104fd2e772843a0974990f965d8b589 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:55.950650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bab9d-7945-4910-83b0-3ac4edd39e45 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:55.987270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1ccce-4369-444a-b21b-bd29dd4d1c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:55.988007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ccce-4369-444a-b21b-bd29dd4d1c20 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:55.988287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ccce-4369-444a-b21b-bd29dd4d1c20 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:55.988563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ccce-4369-444a-b21b-bd29dd4d1c20 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:55.989233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ccce-4369-444a-b21b-bd29dd4d1c20 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:55.989541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ccce-4369-444a-b21b-bd29dd4d1c20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:55.991020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ccce-4369-444a-b21b-bd29dd4d1c20 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:56.002002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 424/855] 10.222.0.72 () {56 vars in 1126 bytes} [Mon May 16 18:35:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:56.003614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dd1db-85cb-40d2-8162-9b51639662e3 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:56.120719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dd1db-85cb-40d2-8162-9b51639662e3 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:56.159926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5fe56-a27b-410b-8642-226b35dfbfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:56.160601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5fe56-a27b-410b-8642-226b35dfbfc6 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:56.160880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5fe56-a27b-410b-8642-226b35dfbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:56.161152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5fe56-a27b-410b-8642-226b35dfbfc6 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:56.161859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5fe56-a27b-410b-8642-226b35dfbfc6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:56.162160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5fe56-a27b-410b-8642-226b35dfbfc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:56.163511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5fe56-a27b-410b-8642-226b35dfbfc6 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:56.171829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 432/856] 10.222.0.72 () {56 vars in 1126 bytes} [Mon May 16 18:35:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:56.294019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bf296-4c78-48d5-a02b-42f56a7dfc56 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:56.294373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bf296-4c78-48d5-a02b-42f56a7dfc56 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:56.294578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bf296-4c78-48d5-a02b-42f56a7dfc56 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:56.296318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 425/857] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:56.302198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af378f-ccc0-4549-b94b-46f27eea7dc8 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:56.303061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af378f-ccc0-4549-b94b-46f27eea7dc8 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:56.303061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af378f-ccc0-4549-b94b-46f27eea7dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:56.321279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-80af378f-ccc0-4549-b94b-46f27eea7dc8 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:56.323049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-80af378f-ccc0-4549-b94b-46f27eea7dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:56.395311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 433/858] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:35:56.418711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bf296-4c78-48d5-a02b-42f56a7dfc56 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:56.520995 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bf296-4c78-48d5-a02b-42f56a7dfc56 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:56.560357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d0fbb-3d30-4abc-8453-e06ef1739316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:56.561569 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d0fbb-3d30-4abc-8453-e06ef1739316 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:56.562100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d0fbb-3d30-4abc-8453-e06ef1739316 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:56.562586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d0fbb-3d30-4abc-8453-e06ef1739316 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:56.573820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d0fbb-3d30-4abc-8453-e06ef1739316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-c56d0fbb-3d30-4abc-8453-e06ef1739316 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:35:56.581951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:56.582965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:35:56.583905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:56.586720 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 426/859] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:56.592410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af378f-ccc0-4549-b94b-46f27eea7dc8 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:56.692371 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af378f-ccc0-4549-b94b-46f27eea7dc8 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:56.727577 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38170d9-3253-464c-a1bd-533b34d091a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:56.728312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38170d9-3253-464c-a1bd-533b34d091a6 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:56.728593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38170d9-3253-464c-a1bd-533b34d091a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:56.728869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38170d9-3253-464c-a1bd-533b34d091a6 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:56.729635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38170d9-3253-464c-a1bd-533b34d091a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:56.730011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38170d9-3253-464c-a1bd-533b34d091a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:56.731380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38170d9-3253-464c-a1bd-533b34d091a6 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:56.740109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 434/860] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:56.745648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d0fbb-3d30-4abc-8453-e06ef1739316 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:56.850604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d0fbb-3d30-4abc-8453-e06ef1739316 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:56.885557 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941088ed-a2cc-477b-8b25-b7168d9a5706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:56.886776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941088ed-a2cc-477b-8b25-b7168d9a5706 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:56.887278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941088ed-a2cc-477b-8b25-b7168d9a5706 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:56.887797 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941088ed-a2cc-477b-8b25-b7168d9a5706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:56.898760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941088ed-a2cc-477b-8b25-b7168d9a5706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:56.901034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941088ed-a2cc-477b-8b25-b7168d9a5706 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-941088ed-a2cc-477b-8b25-b7168d9a5706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:56.918932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:56.919918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:56.920835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:56.920835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:56.920835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:56.920835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:56.923090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 427/861] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:56.928544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38170d9-3253-464c-a1bd-533b34d091a6 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:57.034893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38170d9-3253-464c-a1bd-533b34d091a6 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:57.068896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab910e-0e49-4ef3-b7c8-a25bb953eca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:57.069626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab910e-0e49-4ef3-b7c8-a25bb953eca2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:57.069914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab910e-0e49-4ef3-b7c8-a25bb953eca2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:57.070190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab910e-0e49-4ef3-b7c8-a25bb953eca2 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:57.070976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab910e-0e49-4ef3-b7c8-a25bb953eca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:57.071284 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab910e-0e49-4ef3-b7c8-a25bb953eca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:57.072753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab910e-0e49-4ef3-b7c8-a25bb953eca2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:57.085252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 435/862] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:57.091200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941088ed-a2cc-477b-8b25-b7168d9a5706 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:57.197977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941088ed-a2cc-477b-8b25-b7168d9a5706 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:57.232355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832d30-7af1-4c0c-bd97-c24ed03a6617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:57.233450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832d30-7af1-4c0c-bd97-c24ed03a6617 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:57.233893 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832d30-7af1-4c0c-bd97-c24ed03a6617 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:57.234339 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832d30-7af1-4c0c-bd97-c24ed03a6617 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:57.242503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b832d30-7af1-4c0c-bd97-c24ed03a6617 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:57.244691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b832d30-7af1-4c0c-bd97-c24ed03a6617 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-6b832d30-7af1-4c0c-bd97-c24ed03a6617 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:35:57.260490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:57.261702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:57.262879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:57.262879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:57.262879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:35:57.262879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:35:57.262879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:35:57.262879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:35:57.262879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:35:57.262879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:35:57.262879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:35:57.262879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:57.265185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 428/863] 10.222.0.72 () {56 vars in 1117 bytes} [Mon May 16 18:35:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:57.270628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab910e-0e49-4ef3-b7c8-a25bb953eca2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:57.382821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab910e-0e49-4ef3-b7c8-a25bb953eca2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:57.418285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643c974-8893-4aad-95c5-473b09cf629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:57.418956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c974-8893-4aad-95c5-473b09cf629e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:57.419237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c974-8893-4aad-95c5-473b09cf629e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:57.419518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c974-8893-4aad-95c5-473b09cf629e None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:57.420387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643c974-8893-4aad-95c5-473b09cf629e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:57.420695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643c974-8893-4aad-95c5-473b09cf629e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:57.422170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643c974-8893-4aad-95c5-473b09cf629e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:57.440070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 436/864] 10.222.0.72 () {56 vars in 1149 bytes} [Mon May 16 18:35:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:57.445547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832d30-7af1-4c0c-bd97-c24ed03a6617 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:57.532460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092024d9-a9b8-4c89-b9ad-479c5521d68c None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:57.532788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092024d9-a9b8-4c89-b9ad-479c5521d68c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:57.533026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092024d9-a9b8-4c89-b9ad-479c5521d68c None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:57.534635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 437/865] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:57.539486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53297a56-b237-406a-b6b6-71eaa79eb721 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:57.539809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53297a56-b237-406a-b6b6-71eaa79eb721 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:57.540097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53297a56-b237-406a-b6b6-71eaa79eb721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:57.546444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832d30-7af1-4c0c-bd97-c24ed03a6617 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:57.557482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-53297a56-b237-406a-b6b6-71eaa79eb721 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:57.558830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-53297a56-b237-406a-b6b6-71eaa79eb721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:57.585013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479c49f-105e-43ed-badd-685ec83af996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:57.585774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479c49f-105e-43ed-badd-685ec83af996 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:57.586086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479c49f-105e-43ed-badd-685ec83af996 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:57.586375 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479c49f-105e-43ed-badd-685ec83af996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:57.640138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 438/866] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:35:57.658578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479c49f-105e-43ed-badd-685ec83af996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:57.659458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53297a56-b237-406a-b6b6-71eaa79eb721 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:57.660075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479c49f-105e-43ed-badd-685ec83af996 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:57.761244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 429/867] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:35:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:35:57.767180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479c49f-105e-43ed-badd-685ec83af996 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:57.771533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53297a56-b237-406a-b6b6-71eaa79eb721 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:57.807307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37144491-e012-4bcc-b042-469c45d73535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:57.808535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144491-e012-4bcc-b042-469c45d73535 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:57.809055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144491-e012-4bcc-b042-469c45d73535 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:57.809534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144491-e012-4bcc-b042-469c45d73535 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:57.810468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37144491-e012-4bcc-b042-469c45d73535 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:57.812109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37144491-e012-4bcc-b042-469c45d73535 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:57.835744 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 439/868] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:35:57 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:35:57.882260 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479c49f-105e-43ed-badd-685ec83af996 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:57.938780 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1067b6-a4ca-4c37-af15-011c0f89dfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:57.939796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1067b6-a4ca-4c37-af15-011c0f89dfcb None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:57.940087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1067b6-a4ca-4c37-af15-011c0f89dfcb None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:57.940413 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1067b6-a4ca-4c37-af15-011c0f89dfcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:57.952714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1067b6-a4ca-4c37-af15-011c0f89dfcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:57.954201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1067b6-a4ca-4c37-af15-011c0f89dfcb None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-0d1067b6-a4ca-4c37-af15-011c0f89dfcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:35:57.975090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:57.976115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:57.977011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:35:57.977011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:35:57.977011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:35:57.977011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:57.977011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 430/869] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:57.985107 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37144491-e012-4bcc-b042-469c45d73535 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:58.095184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37144491-e012-4bcc-b042-469c45d73535 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:58.128671 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23e9a5-9543-4e84-b11b-0e97207999c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:58.129747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23e9a5-9543-4e84-b11b-0e97207999c5 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:58.130246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23e9a5-9543-4e84-b11b-0e97207999c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:58.130738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23e9a5-9543-4e84-b11b-0e97207999c5 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:58.131683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23e9a5-9543-4e84-b11b-0e97207999c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:58.132234 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23e9a5-9543-4e84-b11b-0e97207999c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:58.133813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23e9a5-9543-4e84-b11b-0e97207999c5 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:58.147171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 440/870] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:58.154143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1067b6-a4ca-4c37-af15-011c0f89dfcb None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:58.263923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1067b6-a4ca-4c37-af15-011c0f89dfcb None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:58.300832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c1b51-1fe6-43a4-837d-4b8e6ad8e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:58.302037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c1b51-1fe6-43a4-837d-4b8e6ad8e64f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:58.302542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c1b51-1fe6-43a4-837d-4b8e6ad8e64f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:58.303027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c1b51-1fe6-43a4-837d-4b8e6ad8e64f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:58.311760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c1b51-1fe6-43a4-837d-4b8e6ad8e64f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:58.313618 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c1b51-1fe6-43a4-837d-4b8e6ad8e64f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-d47c1b51-1fe6-43a4-837d-4b8e6ad8e64f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:35:58.330344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:58.331287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:58.332217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:35:58.332217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:35:58.332217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:35:58.332217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:35:58.332217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:35:58.332217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:35:58.332217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:35:58.332217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:35:58.334747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 431/871] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:35:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:58.341257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23e9a5-9543-4e84-b11b-0e97207999c5 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:58.351586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c64d-b902-4caa-8d62-0c48dd32fa31 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:58.351926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c64d-b902-4caa-8d62-0c48dd32fa31 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:58.352187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c64d-b902-4caa-8d62-0c48dd32fa31 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:58.354435 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 432/872] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:35:58.359538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d755125-430f-445d-a08c-0119463ed3dd None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:58.359861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d755125-430f-445d-a08c-0119463ed3dd None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:58.360157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d755125-430f-445d-a08c-0119463ed3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:58.378692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-9d755125-430f-445d-a08c-0119463ed3dd None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:58.380816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9d755125-430f-445d-a08c-0119463ed3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:58.453451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23e9a5-9543-4e84-b11b-0e97207999c5 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:58.463222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 433/873] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:35:58.463222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf2e3a-1998-48c5-928c-76a6f5028c40 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:58.463222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf2e3a-1998-48c5-928c-76a6f5028c40 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:58.463222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf2e3a-1998-48c5-928c-76a6f5028c40 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:58.463222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 434/874] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:35:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:35:58.464464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1890ba-e2ed-494b-83d5-e64aae862a7a None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:58.464749 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1890ba-e2ed-494b-83d5-e64aae862a7a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:58.465024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1890ba-e2ed-494b-83d5-e64aae862a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:58.483579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4b1890ba-e2ed-494b-83d5-e64aae862a7a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:35:58.484954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4b1890ba-e2ed-494b-83d5-e64aae862a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:35:58.492612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e67560-8af9-4d1f-9883-1da121fc8d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:58.493815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e67560-8af9-4d1f-9883-1da121fc8d2a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:58.494105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e67560-8af9-4d1f-9883-1da121fc8d2a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:58.494389 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e67560-8af9-4d1f-9883-1da121fc8d2a None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:58.495211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e67560-8af9-4d1f-9883-1da121fc8d2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:58.495490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e67560-8af9-4d1f-9883-1da121fc8d2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:58.496957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e67560-8af9-4d1f-9883-1da121fc8d2a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:58.514116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 441/875] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:58.514116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e67560-8af9-4d1f-9883-1da121fc8d2a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:58.554611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 435/876] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:35:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:35:58.555863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1890ba-e2ed-494b-83d5-e64aae862a7a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:58.630509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e67560-8af9-4d1f-9883-1da121fc8d2a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:58.652679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1890ba-e2ed-494b-83d5-e64aae862a7a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:58.664377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7224-59b3-4140-abb9-a71c055e7aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:58.665212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7224-59b3-4140-abb9-a71c055e7aa2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:58.665496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7224-59b3-4140-abb9-a71c055e7aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:58.665770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7224-59b3-4140-abb9-a71c055e7aa2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:58.666432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f7224-59b3-4140-abb9-a71c055e7aa2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:58.667822 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f7224-59b3-4140-abb9-a71c055e7aa2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-fa8f7224-59b3-4140-abb9-a71c055e7aa2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:35:58.679885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:35:58.681441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:35:58.682321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 442/877] 10.222.0.72 () {56 vars in 1126 bytes} [Mon May 16 18:35:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:35:58.683776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7224-59b3-4140-abb9-a71c055e7aa2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:58.692030 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaa1fb-6697-4615-b8b2-56408bcc4d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:58.692693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaa1fb-6697-4615-b8b2-56408bcc4d26 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:58.692978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaa1fb-6697-4615-b8b2-56408bcc4d26 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:58.693271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaa1fb-6697-4615-b8b2-56408bcc4d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:58.694093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaa1fb-6697-4615-b8b2-56408bcc4d26 None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=213dd48e9a5d46dda298caf8cbffce9e) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:58.694403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaa1fb-6697-4615-b8b2-56408bcc4d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:58.695891 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaa1fb-6697-4615-b8b2-56408bcc4d26 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:58.711787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 436/878] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:35:58 2022] GET /identity/v3/role_assignments?user.id=213dd48e9a5d46dda298caf8cbffce9e&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:58.711787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaa1fb-6697-4615-b8b2-56408bcc4d26 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:58.798735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7224-59b3-4140-abb9-a71c055e7aa2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:58.835034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b3483-93f7-4e13-acca-22877b55445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:58.835877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b3483-93f7-4e13-acca-22877b55445a None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:58.836239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b3483-93f7-4e13-acca-22877b55445a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:58.836586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b3483-93f7-4e13-acca-22877b55445a None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:58.838009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b3483-93f7-4e13-acca-22877b55445a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:58.839538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b3483-93f7-4e13-acca-22877b55445a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:58.846136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaa1fb-6697-4615-b8b2-56408bcc4d26 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:58.864400 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 443/879] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:35:58 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:35:58.902750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d1e3a-b5a1-471c-a89a-1d529dfb95fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:58.903511 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d1e3a-b5a1-471c-a89a-1d529dfb95fc None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:58.903834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d1e3a-b5a1-471c-a89a-1d529dfb95fc None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:58.904091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d1e3a-b5a1-471c-a89a-1d529dfb95fc None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:58.904890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d1e3a-b5a1-471c-a89a-1d529dfb95fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:58.905217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d1e3a-b5a1-471c-a89a-1d529dfb95fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:58.906640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d1e3a-b5a1-471c-a89a-1d529dfb95fc None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:58.918282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 437/880] 10.222.0.72 () {56 vars in 1122 bytes} [Mon May 16 18:35:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:35:58.924101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b3483-93f7-4e13-acca-22877b55445a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:35:59.057712 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b3483-93f7-4e13-acca-22877b55445a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:35:59.096384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d64323-b788-4f16-aada-f98f11ad1ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:35:59.097487 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64323-b788-4f16-aada-f98f11ad1ab1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:35:59.098031 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64323-b788-4f16-aada-f98f11ad1ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:35:59.098509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d64323-b788-4f16-aada-f98f11ad1ab1 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:35:59.099508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d64323-b788-4f16-aada-f98f11ad1ab1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:35:59.100061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d64323-b788-4f16-aada-f98f11ad1ab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:35:59.101698 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d64323-b788-4f16-aada-f98f11ad1ab1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:35:59.107838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 444/881] 10.222.0.72 () {56 vars in 1122 bytes} [Mon May 16 18:35:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:00.232572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29a1d8-40c3-4e81-84b2-91c0b5f98530 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:00.233095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29a1d8-40c3-4e81-84b2-91c0b5f98530 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:00.233095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29a1d8-40c3-4e81-84b2-91c0b5f98530 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:00.234628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 438/882] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:00.240058 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcec008-c513-44f8-97d4-320339bc6072 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:00.240455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcec008-c513-44f8-97d4-320339bc6072 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:00.240662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcec008-c513-44f8-97d4-320339bc6072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:00.257617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-cfcec008-c513-44f8-97d4-320339bc6072 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:00.258791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-cfcec008-c513-44f8-97d4-320339bc6072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:00.327662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 445/883] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:00.350281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29a1d8-40c3-4e81-84b2-91c0b5f98530 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:00.457916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29a1d8-40c3-4e81-84b2-91c0b5f98530 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:00.493281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25353453-6c3b-4ce6-9a7e-ffcb146ff069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:00.494080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25353453-6c3b-4ce6-9a7e-ffcb146ff069 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:00.494367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25353453-6c3b-4ce6-9a7e-ffcb146ff069 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:00.494648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25353453-6c3b-4ce6-9a7e-ffcb146ff069 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:00.495309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25353453-6c3b-4ce6-9a7e-ffcb146ff069 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:00.496735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25353453-6c3b-4ce6-9a7e-ffcb146ff069 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-25353453-6c3b-4ce6-9a7e-ffcb146ff069 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:00.509754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:00.512115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:00.514047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 439/884] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:36:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:00.519729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcec008-c513-44f8-97d4-320339bc6072 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:00.619108 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcec008-c513-44f8-97d4-320339bc6072 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:00.653128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525076e6-e417-44ca-927e-5aff35f782fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:00.653806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525076e6-e417-44ca-927e-5aff35f782fa None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:00.654092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525076e6-e417-44ca-927e-5aff35f782fa None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:00.654367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525076e6-e417-44ca-927e-5aff35f782fa None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:00.655086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525076e6-e417-44ca-927e-5aff35f782fa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:00.655392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525076e6-e417-44ca-927e-5aff35f782fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:00.656803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525076e6-e417-44ca-927e-5aff35f782fa None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:00.661815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 446/885] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:36:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:00.668820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25353453-6c3b-4ce6-9a7e-ffcb146ff069 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:00.769179 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25353453-6c3b-4ce6-9a7e-ffcb146ff069 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:00.803573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaebd36-270b-497a-a79a-6f0210a675e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:00.804281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaebd36-270b-497a-a79a-6f0210a675e7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:00.804599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaebd36-270b-497a-a79a-6f0210a675e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:00.804905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaebd36-270b-497a-a79a-6f0210a675e7 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:00.805668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaebd36-270b-497a-a79a-6f0210a675e7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:00.806614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaebd36-270b-497a-a79a-6f0210a675e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:00.808131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaebd36-270b-497a-a79a-6f0210a675e7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:00.813680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 440/886] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:36:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:00.820829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525076e6-e417-44ca-927e-5aff35f782fa None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:00.921646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525076e6-e417-44ca-927e-5aff35f782fa None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:00.960096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc823a-2bc5-4c5b-9630-0e09171d7976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:00.960762 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc823a-2bc5-4c5b-9630-0e09171d7976 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:00.961042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc823a-2bc5-4c5b-9630-0e09171d7976 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:00.961313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc823a-2bc5-4c5b-9630-0e09171d7976 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:00.962627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc823a-2bc5-4c5b-9630-0e09171d7976 None admin] RBAC: Adding query filter params (interface=public, service_id=d91410989ff74fbfbcb01a02209b65aa, region_id=RegionOne) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:00.962924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc823a-2bc5-4c5b-9630-0e09171d7976 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:00.964310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc823a-2bc5-4c5b-9630-0e09171d7976 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:00.970276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 447/887] 10.222.0.72 () {56 vars in 1251 bytes} [Mon May 16 18:36:00 2022] GET /identity/v3/endpoints?service_id=d91410989ff74fbfbcb01a02209b65aa&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:00.975649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaebd36-270b-497a-a79a-6f0210a675e7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:01.083445 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaebd36-270b-497a-a79a-6f0210a675e7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:01.119489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35684f-1a14-4e0c-b8bd-2ec397998264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:01.120201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35684f-1a14-4e0c-b8bd-2ec397998264 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.120492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35684f-1a14-4e0c-b8bd-2ec397998264 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.120779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35684f-1a14-4e0c-b8bd-2ec397998264 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.121474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35684f-1a14-4e0c-b8bd-2ec397998264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:01.122339 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bbbd9-6bab-4e05-8d72-8e4637897048 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.122630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bbbd9-6bab-4e05-8d72-8e4637897048 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.122859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35684f-1a14-4e0c-b8bd-2ec397998264 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:01.122963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bbbd9-6bab-4e05-8d72-8e4637897048 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.125645 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 448/888] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:01.129145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 441/889] 10.222.0.72 () {56 vars in 1087 bytes} [Mon May 16 18:36:00 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:36:01.129749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109407-4173-4930-bda0-09a20a63e772 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.130157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109407-4173-4930-bda0-09a20a63e772 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.130441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109407-4173-4930-bda0-09a20a63e772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.153172 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c9109407-4173-4930-bda0-09a20a63e772 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:01.154462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c9109407-4173-4930-bda0-09a20a63e772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:01.235882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 449/890] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:01.255654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35684f-1a14-4e0c-b8bd-2ec397998264 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:01.256594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06439c3d-3823-4470-a76b-788df2e33728 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.256982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06439c3d-3823-4470-a76b-788df2e33728 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.257148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06439c3d-3823-4470-a76b-788df2e33728 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.258804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 450/891] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:01.264947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5fa44-9c45-4c33-a537-d70677d739f8 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.265229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5fa44-9c45-4c33-a537-d70677d739f8 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.265505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5fa44-9c45-4c33-a537-d70677d739f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.289832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-36f5fa44-9c45-4c33-a537-d70677d739f8 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:01.291952 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-36f5fa44-9c45-4c33-a537-d70677d739f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:01.384647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 451/892] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:01.386671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35684f-1a14-4e0c-b8bd-2ec397998264 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:01.406767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5fa44-9c45-4c33-a537-d70677d739f8 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:01.431263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aff026-a2e8-4520-b4eb-c038dfff7899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:01.432661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff026-a2e8-4520-b4eb-c038dfff7899 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.433050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff026-a2e8-4520-b4eb-c038dfff7899 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.433427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff026-a2e8-4520-b4eb-c038dfff7899 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.447037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aff026-a2e8-4520-b4eb-c038dfff7899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-a8aff026-a2e8-4520-b4eb-c038dfff7899 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:01.457656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:01.458823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:01.459800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:01.460785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 442/893] 10.222.0.72 () {56 vars in 1120 bytes} [Mon May 16 18:36:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:01.466785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aff026-a2e8-4520-b4eb-c038dfff7899 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:01.532865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5fa44-9c45-4c33-a537-d70677d739f8 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:01.567236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff3d0d-1c30-4bd7-b83c-a9fadc598bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:01.568083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff3d0d-1c30-4bd7-b83c-a9fadc598bad None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.568368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff3d0d-1c30-4bd7-b83c-a9fadc598bad None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.568640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff3d0d-1c30-4bd7-b83c-a9fadc598bad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.569299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff3d0d-1c30-4bd7-b83c-a9fadc598bad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:01.570772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff3d0d-1c30-4bd7-b83c-a9fadc598bad None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:01.578054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aff026-a2e8-4520-b4eb-c038dfff7899 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-e1ff3d0d-1c30-4bd7-b83c-a9fadc598bad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:01.583593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:01.584685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:01.585515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 452/894] 10.222.0.72 () {56 vars in 1132 bytes} [Mon May 16 18:36:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:01.586832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a006-c389-41b5-8e0b-f32b67103412 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.586832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a006-c389-41b5-8e0b-f32b67103412 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.587165 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a006-c389-41b5-8e0b-f32b67103412 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.588655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 453/895] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:01.590859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6a006-c389-41b5-8e0b-f32b67103412 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:01.618856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa2ea3-b64b-4e33-ad63-ad8e5044859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:01.619887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa2ea3-b64b-4e33-ad63-ad8e5044859f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.620177 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa2ea3-b64b-4e33-ad63-ad8e5044859f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.620612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa2ea3-b64b-4e33-ad63-ad8e5044859f None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.621371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa2ea3-b64b-4e33-ad63-ad8e5044859f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:01.621680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa2ea3-b64b-4e33-ad63-ad8e5044859f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:01.623053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa2ea3-b64b-4e33-ad63-ad8e5044859f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:01.636007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 443/896] 10.222.0.72 () {56 vars in 1115 bytes} [Mon May 16 18:36:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:01.636007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ce85c-89b5-42b3-bf1b-a0eedf86bf33 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.636007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ce85c-89b5-42b3-bf1b-a0eedf86bf33 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.636007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ce85c-89b5-42b3-bf1b-a0eedf86bf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.650338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-634ce85c-89b5-42b3-bf1b-a0eedf86bf33 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:01.651513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-634ce85c-89b5-42b3-bf1b-a0eedf86bf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:01.701330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6a006-c389-41b5-8e0b-f32b67103412 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:01.720289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 444/897] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:01.721398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ce85c-89b5-42b3-bf1b-a0eedf86bf33 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:01.754830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa1fc6-198f-4437-9fc5-2cdf4ee299e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:01.755534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa1fc6-198f-4437-9fc5-2cdf4ee299e4 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.755850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa1fc6-198f-4437-9fc5-2cdf4ee299e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.756128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa1fc6-198f-4437-9fc5-2cdf4ee299e4 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.756841 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa1fc6-198f-4437-9fc5-2cdf4ee299e4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:01.757148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa1fc6-198f-4437-9fc5-2cdf4ee299e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:01.758640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa1fc6-198f-4437-9fc5-2cdf4ee299e4 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:01.764017 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 454/898] 10.222.0.72 () {56 vars in 1126 bytes} [Mon May 16 18:36:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:01.764600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa1fc6-198f-4437-9fc5-2cdf4ee299e4 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:01.831470 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ce85c-89b5-42b3-bf1b-a0eedf86bf33 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:01.863431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa1fc6-198f-4437-9fc5-2cdf4ee299e4 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:01.865125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258278f-9af4-4d2b-80d8-7e3b149f8306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:01.866040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258278f-9af4-4d2b-80d8-7e3b149f8306 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.866389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258278f-9af4-4d2b-80d8-7e3b149f8306 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.866739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258278f-9af4-4d2b-80d8-7e3b149f8306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.878097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258278f-9af4-4d2b-80d8-7e3b149f8306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:01.879553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258278f-9af4-4d2b-80d8-7e3b149f8306 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:01.898362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82859a6-a183-4a1b-8ea3-19b490e67cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:01.898956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82859a6-a183-4a1b-8ea3-19b490e67cea None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:01.899235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82859a6-a183-4a1b-8ea3-19b490e67cea None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:01.899615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82859a6-a183-4a1b-8ea3-19b490e67cea None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:01.900408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82859a6-a183-4a1b-8ea3-19b490e67cea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-4258278f-9af4-4d2b-80d8-7e3b149f8306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:01.901378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:01.902292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:01.903191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:01.903191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:01.903191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:01.903191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:01.908975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82859a6-a183-4a1b-8ea3-19b490e67cea None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:01.909053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 445/899] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:01.909053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258278f-9af4-4d2b-80d8-7e3b149f8306 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:01.918884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 455/900] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:36:01 2022] POST /identity/v3/services => generated 241 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:36:01.920053 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82859a6-a183-4a1b-8ea3-19b490e67cea None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:02.040719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82859a6-a183-4a1b-8ea3-19b490e67cea None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:02.054241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258278f-9af4-4d2b-80d8-7e3b149f8306 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:02.077608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144169d8-235e-425c-8c94-1708491255ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:02.078293 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144169d8-235e-425c-8c94-1708491255ab None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:02.078569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144169d8-235e-425c-8c94-1708491255ab None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:02.078841 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144169d8-235e-425c-8c94-1708491255ab None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:02.079578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144169d8-235e-425c-8c94-1708491255ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:02.079918 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144169d8-235e-425c-8c94-1708491255ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:02.081295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144169d8-235e-425c-8c94-1708491255ab None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:02.093910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100e4b2-0b2b-42d8-b27f-db68068248f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:02.094972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e4b2-0b2b-42d8-b27f-db68068248f8 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:02.095463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e4b2-0b2b-42d8-b27f-db68068248f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:02.096088 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e4b2-0b2b-42d8-b27f-db68068248f8 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:02.097037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100e4b2-0b2b-42d8-b27f-db68068248f8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:02.097573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100e4b2-0b2b-42d8-b27f-db68068248f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:02.099232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 456/901] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:02.099907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100e4b2-0b2b-42d8-b27f-db68068248f8 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:02.100193 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144169d8-235e-425c-8c94-1708491255ab None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:02.107310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 446/902] 10.222.0.72 () {56 vars in 1126 bytes} [Mon May 16 18:36:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:02.112973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100e4b2-0b2b-42d8-b27f-db68068248f8 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:02.220427 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144169d8-235e-425c-8c94-1708491255ab None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:02.223771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100e4b2-0b2b-42d8-b27f-db68068248f8 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:02.261478 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91058b14-6dce-4aff-b783-badcf8bdb4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:02.262586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91058b14-6dce-4aff-b783-badcf8bdb4c3 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:02.262908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91058b14-6dce-4aff-b783-badcf8bdb4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:02.263188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91058b14-6dce-4aff-b783-badcf8bdb4c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:02.263296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32738b8f-8f5f-494f-ba39-c5c8a6b35880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:02.263884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32738b8f-8f5f-494f-ba39-c5c8a6b35880 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:02.264170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32738b8f-8f5f-494f-ba39-c5c8a6b35880 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:02.264451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32738b8f-8f5f-494f-ba39-c5c8a6b35880 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:02.265262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32738b8f-8f5f-494f-ba39-c5c8a6b35880 None admin] RBAC: Adding query filter params (interface=public, service_id=ea7368f7a38a425394778fdb31b57b36, region_id=RegionOne) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:02.265574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32738b8f-8f5f-494f-ba39-c5c8a6b35880 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:02.266948 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32738b8f-8f5f-494f-ba39-c5c8a6b35880 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:02.270598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91058b14-6dce-4aff-b783-badcf8bdb4c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:02.272052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91058b14-6dce-4aff-b783-badcf8bdb4c3 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:02.272508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 447/903] 10.222.0.72 () {56 vars in 1251 bytes} [Mon May 16 18:36:02 2022] GET /identity/v3/endpoints?service_id=ea7368f7a38a425394778fdb31b57b36&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:02.278312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32738b8f-8f5f-494f-ba39-c5c8a6b35880 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-91058b14-6dce-4aff-b783-badcf8bdb4c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:36:02.288070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:02.289139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:02.292164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:02.292164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:02.292164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:36:02.292164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:36:02.292164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:36:02.292164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:36:02.292164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:36:02.292164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:36:02.292164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:36:02.292164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:02.292164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 457/904] 10.222.0.72 () {56 vars in 1117 bytes} [Mon May 16 18:36:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:02.299834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91058b14-6dce-4aff-b783-badcf8bdb4c3 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:02.380491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32738b8f-8f5f-494f-ba39-c5c8a6b35880 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:02.406789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91058b14-6dce-4aff-b783-badcf8bdb4c3 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:02.413976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bc555-157c-46ff-8562-f0b1427e2456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:02.414645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bc555-157c-46ff-8562-f0b1427e2456 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:02.414930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bc555-157c-46ff-8562-f0b1427e2456 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:02.415284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bc555-157c-46ff-8562-f0b1427e2456 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:02.418373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bc555-157c-46ff-8562-f0b1427e2456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:02.418373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bc555-157c-46ff-8562-f0b1427e2456 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:02.427974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 448/905] 10.222.0.72 () {56 vars in 1087 bytes} [Mon May 16 18:36:02 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:36:02.450322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f014f-4824-4d50-a66c-d8dcca54eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:02.451317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f014f-4824-4d50-a66c-d8dcca54eb62 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:02.451806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f014f-4824-4d50-a66c-d8dcca54eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:02.452236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f014f-4824-4d50-a66c-d8dcca54eb62 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:02.453288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f014f-4824-4d50-a66c-d8dcca54eb62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:02.453768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f014f-4824-4d50-a66c-d8dcca54eb62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:02.455416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f014f-4824-4d50-a66c-d8dcca54eb62 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:02.476867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 458/906] 10.222.0.72 () {56 vars in 1149 bytes} [Mon May 16 18:36:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:02.487745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bc555-157c-46ff-8562-f0b1427e2456 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:02.600821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bc555-157c-46ff-8562-f0b1427e2456 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:02.640347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d5a4f-7af1-481d-9fa1-fb1dc65867df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:02.641292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d5a4f-7af1-481d-9fa1-fb1dc65867df None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:02.641778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d5a4f-7af1-481d-9fa1-fb1dc65867df None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:02.642226 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d5a4f-7af1-481d-9fa1-fb1dc65867df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:02.708245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d5a4f-7af1-481d-9fa1-fb1dc65867df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:02.709978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d5a4f-7af1-481d-9fa1-fb1dc65867df None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:02.810857 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 449/907] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:02 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:36:02.816480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f014f-4824-4d50-a66c-d8dcca54eb62 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:02.919352 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f014f-4824-4d50-a66c-d8dcca54eb62 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:02.952714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15eff7-bcf7-4805-b1c1-4d1f3042a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:02.953511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15eff7-bcf7-4805-b1c1-4d1f3042a684 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:02.953787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15eff7-bcf7-4805-b1c1-4d1f3042a684 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:02.954108 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15eff7-bcf7-4805-b1c1-4d1f3042a684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:02.964485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15eff7-bcf7-4805-b1c1-4d1f3042a684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:02.965915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15eff7-bcf7-4805-b1c1-4d1f3042a684 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-0c15eff7-bcf7-4805-b1c1-4d1f3042a684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:02.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:02.985294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:02.986204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:02.986204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:02.986204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:02.986204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:02.986204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 459/908] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:02.991383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d5a4f-7af1-481d-9fa1-fb1dc65867df None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:03.097956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d5a4f-7af1-481d-9fa1-fb1dc65867df None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:03.133170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e4d32-169d-4a5a-883f-e401783559ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:03.134836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e4d32-169d-4a5a-883f-e401783559ef None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:03.135326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e4d32-169d-4a5a-883f-e401783559ef None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:03.135836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e4d32-169d-4a5a-883f-e401783559ef None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:03.136800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e4d32-169d-4a5a-883f-e401783559ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:03.137339 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e4d32-169d-4a5a-883f-e401783559ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:03.138967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e4d32-169d-4a5a-883f-e401783559ef None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:03.152401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 450/909] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:03.160279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15eff7-bcf7-4805-b1c1-4d1f3042a684 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:03.255455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15eff7-bcf7-4805-b1c1-4d1f3042a684 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:03.289456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85de1ba-b2eb-45e7-903a-a6330487937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:03.291005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de1ba-b2eb-45e7-903a-a6330487937b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:03.291286 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de1ba-b2eb-45e7-903a-a6330487937b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:03.291564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de1ba-b2eb-45e7-903a-a6330487937b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:03.299613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85de1ba-b2eb-45e7-903a-a6330487937b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:03.302110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85de1ba-b2eb-45e7-903a-a6330487937b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-a85de1ba-b2eb-45e7-903a-a6330487937b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:36:03.318897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:03.319881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:03.320845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:36:03.320845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:36:03.320845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:36:03.320845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:36:03.320845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:36:03.320845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:36:03.320845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:03.320845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:03.320845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 460/910] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:03.326110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e4d32-169d-4a5a-883f-e401783559ef None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:03.427364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e4d32-169d-4a5a-883f-e401783559ef None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:03.461089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7f8d0-ced5-432e-9a2e-6e4f9aef4605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:03.462037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f8d0-ced5-432e-9a2e-6e4f9aef4605 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:03.462508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f8d0-ced5-432e-9a2e-6e4f9aef4605 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:03.463112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f8d0-ced5-432e-9a2e-6e4f9aef4605 None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:03.464077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7f8d0-ced5-432e-9a2e-6e4f9aef4605 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:03.464544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7f8d0-ced5-432e-9a2e-6e4f9aef4605 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:03.466101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7f8d0-ced5-432e-9a2e-6e4f9aef4605 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:03.479324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 451/911] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:36:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:03.485361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85de1ba-b2eb-45e7-903a-a6330487937b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:03.486376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad6405-7b20-4c15-b78b-2a3113190fea None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:03.486659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad6405-7b20-4c15-b78b-2a3113190fea None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:03.486932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad6405-7b20-4c15-b78b-2a3113190fea None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:03.488539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 452/912] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:03.494055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f347815-42a7-4e4c-932f-183c47f5bb5e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:03.494394 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f347815-42a7-4e4c-932f-183c47f5bb5e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:03.494774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f347815-42a7-4e4c-932f-183c47f5bb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:03.512824 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0f347815-42a7-4e4c-932f-183c47f5bb5e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:03.514001 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0f347815-42a7-4e4c-932f-183c47f5bb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:03.587811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 453/913] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:03.602191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f347815-42a7-4e4c-932f-183c47f5bb5e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:03.608543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85de1ba-b2eb-45e7-903a-a6330487937b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:03.648775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259edae-9e64-4ab3-b72a-e14d5228099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:03.649973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259edae-9e64-4ab3-b72a-e14d5228099d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:03.650318 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259edae-9e64-4ab3-b72a-e14d5228099d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:03.650701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259edae-9e64-4ab3-b72a-e14d5228099d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:03.651687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259edae-9e64-4ab3-b72a-e14d5228099d None admin] RBAC: Adding query filter params (role.id=be018b67ef8944b2959b4c5d0451f8cc, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=213dd48e9a5d46dda298caf8cbffce9e) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:03.652032 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259edae-9e64-4ab3-b72a-e14d5228099d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:03.653461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259edae-9e64-4ab3-b72a-e14d5228099d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:03.659755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 461/914] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:36:03 2022] GET /identity/v3/role_assignments?user.id=213dd48e9a5d46dda298caf8cbffce9e&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=be018b67ef8944b2959b4c5d0451f8cc => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:03.722138 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f347815-42a7-4e4c-932f-183c47f5bb5e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:03.761087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688b3a9-20a3-4327-9489-b21fabdd0516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:03.761909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b3a9-20a3-4327-9489-b21fabdd0516 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:03.762190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b3a9-20a3-4327-9489-b21fabdd0516 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:03.762464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b3a9-20a3-4327-9489-b21fabdd0516 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:03.763128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688b3a9-20a3-4327-9489-b21fabdd0516 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:03.764548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688b3a9-20a3-4327-9489-b21fabdd0516 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-6688b3a9-20a3-4327-9489-b21fabdd0516 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:03.778240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:03.779309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:03.780516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 454/915] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:36:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:03.787933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259edae-9e64-4ab3-b72a-e14d5228099d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:03.898823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259edae-9e64-4ab3-b72a-e14d5228099d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:03.939753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19e126-065a-4da2-b0fc-eecb980ae619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:03.939753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19e126-065a-4da2-b0fc-eecb980ae619 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:03.939753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19e126-065a-4da2-b0fc-eecb980ae619 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:03.939753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19e126-065a-4da2-b0fc-eecb980ae619 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:03.940138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19e126-065a-4da2-b0fc-eecb980ae619 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:03.940138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19e126-065a-4da2-b0fc-eecb980ae619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:03.940138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19e126-065a-4da2-b0fc-eecb980ae619 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:03.947806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 462/916] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:36:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:03.950243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688b3a9-20a3-4327-9489-b21fabdd0516 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:04.054993 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688b3a9-20a3-4327-9489-b21fabdd0516 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:04.090131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fbbfa-4dc6-4b9e-948d-d8d442a92b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:04.090820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fbbfa-4dc6-4b9e-948d-d8d442a92b3e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:04.091107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fbbfa-4dc6-4b9e-948d-d8d442a92b3e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:04.091389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fbbfa-4dc6-4b9e-948d-d8d442a92b3e None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:04.092155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fbbfa-4dc6-4b9e-948d-d8d442a92b3e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:04.092465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fbbfa-4dc6-4b9e-948d-d8d442a92b3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:04.094148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fbbfa-4dc6-4b9e-948d-d8d442a92b3e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:04.100314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 455/917] 10.222.0.72 () {56 vars in 1114 bytes} [Mon May 16 18:36:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:04.107178 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19e126-065a-4da2-b0fc-eecb980ae619 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:04.214303 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19e126-065a-4da2-b0fc-eecb980ae619 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:04.251171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf79f5-5928-43fe-9ca1-0f3a6614a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:04.251873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf79f5-5928-43fe-9ca1-0f3a6614a395 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:04.252217 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf79f5-5928-43fe-9ca1-0f3a6614a395 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:04.252506 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf79f5-5928-43fe-9ca1-0f3a6614a395 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:04.253268 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf79f5-5928-43fe-9ca1-0f3a6614a395 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:04.254641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf79f5-5928-43fe-9ca1-0f3a6614a395 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:04.274186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 463/918] 10.222.0.72 () {60 vars in 1144 bytes} [Mon May 16 18:36:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:36:04.294087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c148754-ba9c-4dc6-8d9b-30d9be53eb98 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:04.294406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c148754-ba9c-4dc6-8d9b-30d9be53eb98 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:04.294666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c148754-ba9c-4dc6-8d9b-30d9be53eb98 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:04.296451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 456/919] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:04.305478 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08cd23-c683-491c-ade3-fed96d2ba2aa None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:04.308540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08cd23-c683-491c-ade3-fed96d2ba2aa None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:04.308540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08cd23-c683-491c-ade3-fed96d2ba2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:04.331289 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-bb08cd23-c683-491c-ade3-fed96d2ba2aa None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:04.332603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-bb08cd23-c683-491c-ade3-fed96d2ba2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:04.420214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 464/920] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:04.444599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c148754-ba9c-4dc6-8d9b-30d9be53eb98 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:04.556571 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c148754-ba9c-4dc6-8d9b-30d9be53eb98 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:04.593416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a12d7c-4483-4fd9-aefa-eb1909cacee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:04.594647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a12d7c-4483-4fd9-aefa-eb1909cacee1 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:04.595172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a12d7c-4483-4fd9-aefa-eb1909cacee1 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:04.595667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a12d7c-4483-4fd9-aefa-eb1909cacee1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:04.596560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a12d7c-4483-4fd9-aefa-eb1909cacee1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:04.598129 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a12d7c-4483-4fd9-aefa-eb1909cacee1 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-b4a12d7c-4483-4fd9-aefa-eb1909cacee1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:04.611333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:04.612425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:04.613283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:04.616181 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 457/921] 10.222.0.72 () {56 vars in 1126 bytes} [Mon May 16 18:36:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:04.623474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08cd23-c683-491c-ade3-fed96d2ba2aa None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:04.736752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08cd23-c683-491c-ade3-fed96d2ba2aa None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:04.772008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db34a6-8ff9-4d8a-a092-62d5d4c1ee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:04.772680 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db34a6-8ff9-4d8a-a092-62d5d4c1ee36 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:04.772961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db34a6-8ff9-4d8a-a092-62d5d4c1ee36 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:04.773240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db34a6-8ff9-4d8a-a092-62d5d4c1ee36 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:04.773955 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db34a6-8ff9-4d8a-a092-62d5d4c1ee36 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:04.774264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db34a6-8ff9-4d8a-a092-62d5d4c1ee36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:04.775673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db34a6-8ff9-4d8a-a092-62d5d4c1ee36 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:04.780755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 465/922] 10.222.0.72 () {56 vars in 1122 bytes} [Mon May 16 18:36:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:04.789133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a12d7c-4483-4fd9-aefa-eb1909cacee1 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:04.840055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd70f7-f546-49a5-980f-698210ba18e4 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:04.840055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd70f7-f546-49a5-980f-698210ba18e4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:04.840055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd70f7-f546-49a5-980f-698210ba18e4 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:04.840055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 466/923] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:04.845059 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8a246-68d5-478d-afd7-0d2a4f3553b1 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:04.845344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8a246-68d5-478d-afd7-0d2a4f3553b1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:04.845615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8a246-68d5-478d-afd7-0d2a4f3553b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:04.862943 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-ddb8a246-68d5-478d-afd7-0d2a4f3553b1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:04.864144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ddb8a246-68d5-478d-afd7-0d2a4f3553b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:04.913242 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a12d7c-4483-4fd9-aefa-eb1909cacee1 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:04.943995 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 467/924] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:04.956952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eb4c6-11cd-4285-be42-d73514b5ce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:04.957928 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eb4c6-11cd-4285-be42-d73514b5ce58 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:04.958421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eb4c6-11cd-4285-be42-d73514b5ce58 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:04.958905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eb4c6-11cd-4285-be42-d73514b5ce58 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:04.959853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eb4c6-11cd-4285-be42-d73514b5ce58 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:04.960392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eb4c6-11cd-4285-be42-d73514b5ce58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:04.961997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eb4c6-11cd-4285-be42-d73514b5ce58 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:04.968389 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8a246-68d5-478d-afd7-0d2a4f3553b1 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:04.968868 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 458/925] 10.222.0.72 () {56 vars in 1122 bytes} [Mon May 16 18:36:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:04.974621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eb4c6-11cd-4285-be42-d73514b5ce58 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:05.084895 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eb4c6-11cd-4285-be42-d73514b5ce58 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:05.094178 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8a246-68d5-478d-afd7-0d2a4f3553b1 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:05.127513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88a645-46fa-4b78-82e0-9113471d46f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:05.128647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88a645-46fa-4b78-82e0-9113471d46f5 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:05.129109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88a645-46fa-4b78-82e0-9113471d46f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:05.129665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88a645-46fa-4b78-82e0-9113471d46f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:05.130492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536bcca-0b9b-4ac1-a0c8-a132f7e9bd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:05.130902 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88a645-46fa-4b78-82e0-9113471d46f5 None admin] RBAC: Adding query filter params (interface=public, service_id=4e5e0b1b4558490fb05d3842f939b9ce, region_id=RegionOne) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:05.131400 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88a645-46fa-4b78-82e0-9113471d46f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:05.131522 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536bcca-0b9b-4ac1-a0c8-a132f7e9bd73 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:05.131809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536bcca-0b9b-4ac1-a0c8-a132f7e9bd73 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:05.132152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536bcca-0b9b-4ac1-a0c8-a132f7e9bd73 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:05.132876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536bcca-0b9b-4ac1-a0c8-a132f7e9bd73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:05.134457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536bcca-0b9b-4ac1-a0c8-a132f7e9bd73 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:05.134947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88a645-46fa-4b78-82e0-9113471d46f5 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:05.141944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 459/926] 10.222.0.72 () {56 vars in 1251 bytes} [Mon May 16 18:36:04 2022] GET /identity/v3/endpoints?service_id=4e5e0b1b4558490fb05d3842f939b9ce&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:05.147525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88a645-46fa-4b78-82e0-9113471d46f5 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-6536bcca-0b9b-4ac1-a0c8-a132f7e9bd73 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:05.149976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:05.151537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:05.152730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 468/927] 10.222.0.72 () {56 vars in 1132 bytes} [Mon May 16 18:36:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:05.160942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536bcca-0b9b-4ac1-a0c8-a132f7e9bd73 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:05.264688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88a645-46fa-4b78-82e0-9113471d46f5 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:05.285703 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536bcca-0b9b-4ac1-a0c8-a132f7e9bd73 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:05.301856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cadfc-ee86-4cd7-b315-397a14bf06e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:05.302609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cadfc-ee86-4cd7-b315-397a14bf06e7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:05.302819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cadfc-ee86-4cd7-b315-397a14bf06e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:05.303072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cadfc-ee86-4cd7-b315-397a14bf06e7 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:05.303783 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cadfc-ee86-4cd7-b315-397a14bf06e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:05.306083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cadfc-ee86-4cd7-b315-397a14bf06e7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:05.313159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 460/928] 10.222.0.72 () {56 vars in 1087 bytes} [Mon May 16 18:36:05 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:36:05.334117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496a7d2-39f9-47da-a8a0-737febe8ff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:05.334814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496a7d2-39f9-47da-a8a0-737febe8ff07 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:05.335098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496a7d2-39f9-47da-a8a0-737febe8ff07 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:05.335496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496a7d2-39f9-47da-a8a0-737febe8ff07 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:05.336280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496a7d2-39f9-47da-a8a0-737febe8ff07 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:05.336586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496a7d2-39f9-47da-a8a0-737febe8ff07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:05.338531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496a7d2-39f9-47da-a8a0-737febe8ff07 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:05.347973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 469/929] 10.222.0.72 () {56 vars in 1126 bytes} [Mon May 16 18:36:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:05.350860 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cadfc-ee86-4cd7-b315-397a14bf06e7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:05.465665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cadfc-ee86-4cd7-b315-397a14bf06e7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:05.502282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af12c8-3b14-4430-9476-e077ad634f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:05.502962 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af12c8-3b14-4430-9476-e077ad634f3e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:05.503386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af12c8-3b14-4430-9476-e077ad634f3e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:05.503673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af12c8-3b14-4430-9476-e077ad634f3e None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:05.504429 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af12c8-3b14-4430-9476-e077ad634f3e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:05.504734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af12c8-3b14-4430-9476-e077ad634f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:05.506187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af12c8-3b14-4430-9476-e077ad634f3e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:05.515822 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 461/930] 10.222.0.72 () {56 vars in 1126 bytes} [Mon May 16 18:36:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:05.517969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496a7d2-39f9-47da-a8a0-737febe8ff07 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:05.623601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496a7d2-39f9-47da-a8a0-737febe8ff07 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:05.658681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d7f2d-4eea-4dee-8603-958c8d50e1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:05.659798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7f2d-4eea-4dee-8603-958c8d50e1e2 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:05.660300 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7f2d-4eea-4dee-8603-958c8d50e1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:05.660771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7f2d-4eea-4dee-8603-958c8d50e1e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:05.661711 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d7f2d-4eea-4dee-8603-958c8d50e1e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:05.663287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d7f2d-4eea-4dee-8603-958c8d50e1e2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:05.684770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 470/931] 10.222.0.72 () {60 vars in 1144 bytes} [Mon May 16 18:36:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:36:06.049213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e360e7-6a35-43d5-a23d-44842cca91ac None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:06.049587 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e360e7-6a35-43d5-a23d-44842cca91ac None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:06.049798 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e360e7-6a35-43d5-a23d-44842cca91ac None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:06.051358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 462/932] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:06.056827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e082b6-3c4c-4b44-93c4-8eacb1029d2e None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:06.057115 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e082b6-3c4c-4b44-93c4-8eacb1029d2e None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:06.057390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e082b6-3c4c-4b44-93c4-8eacb1029d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:06.078523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-55e082b6-3c4c-4b44-93c4-8eacb1029d2e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:06.080103 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-55e082b6-3c4c-4b44-93c4-8eacb1029d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:06.156981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 471/933] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:06.178982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e360e7-6a35-43d5-a23d-44842cca91ac None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:06.284741 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e360e7-6a35-43d5-a23d-44842cca91ac None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:06.320106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9ac1a-4754-4692-9ce9-ab418ed8f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:06.321034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9ac1a-4754-4692-9ce9-ab418ed8f3fa None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:06.321964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9ac1a-4754-4692-9ce9-ab418ed8f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:06.322364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9ac1a-4754-4692-9ce9-ab418ed8f3fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:06.333019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9ac1a-4754-4692-9ce9-ab418ed8f3fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-a5c9ac1a-4754-4692-9ce9-ab418ed8f3fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:06.342046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:06.343238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:06.344104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 463/934] 10.222.0.72 () {56 vars in 1120 bytes} [Mon May 16 18:36:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:06.349326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e082b6-3c4c-4b44-93c4-8eacb1029d2e None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:06.445539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e082b6-3c4c-4b44-93c4-8eacb1029d2e None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:06.479967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d62417-8cc7-498e-83fc-471f4d4e079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:06.481023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d62417-8cc7-498e-83fc-471f4d4e079b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:06.481502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d62417-8cc7-498e-83fc-471f4d4e079b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:06.481971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d62417-8cc7-498e-83fc-471f4d4e079b None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:06.482929 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d62417-8cc7-498e-83fc-471f4d4e079b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:06.483456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d62417-8cc7-498e-83fc-471f4d4e079b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:06.485030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d62417-8cc7-498e-83fc-471f4d4e079b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:06.493891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 472/935] 10.222.0.72 () {56 vars in 1115 bytes} [Mon May 16 18:36:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:06.503733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9ac1a-4754-4692-9ce9-ab418ed8f3fa None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:06.605909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9ac1a-4754-4692-9ce9-ab418ed8f3fa None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:06.641305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596632eb-3df9-4c0d-b13a-1c8d74f1a743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:06.642519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596632eb-3df9-4c0d-b13a-1c8d74f1a743 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:06.642949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596632eb-3df9-4c0d-b13a-1c8d74f1a743 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:06.643371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596632eb-3df9-4c0d-b13a-1c8d74f1a743 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:06.655563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596632eb-3df9-4c0d-b13a-1c8d74f1a743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:06.657262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596632eb-3df9-4c0d-b13a-1c8d74f1a743 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-596632eb-3df9-4c0d-b13a-1c8d74f1a743 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:06.674509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:06.675616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:06.676766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:06.676766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:06.676766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:06.676766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:06.678640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 464/936] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:06.684538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d62417-8cc7-498e-83fc-471f4d4e079b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:06.752953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ada3-fd0a-48e4-b808-7a3fe4d1ff2f None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:06.753282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ada3-fd0a-48e4-b808-7a3fe4d1ff2f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:06.753514 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ada3-fd0a-48e4-b808-7a3fe4d1ff2f None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:06.755117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 465/937] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:06.760366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5de87-b854-48c4-ac09-72a5783f630f None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:06.760654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5de87-b854-48c4-ac09-72a5783f630f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:06.760934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5de87-b854-48c4-ac09-72a5783f630f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:06.780976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-03c5de87-b854-48c4-ac09-72a5783f630f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:06.782464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-03c5de87-b854-48c4-ac09-72a5783f630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:06.788857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d62417-8cc7-498e-83fc-471f4d4e079b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:06.821963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa07c6-91c5-4e90-902d-f12ccf43f388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:06.822683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa07c6-91c5-4e90-902d-f12ccf43f388 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:06.822966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa07c6-91c5-4e90-902d-f12ccf43f388 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:06.823234 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa07c6-91c5-4e90-902d-f12ccf43f388 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:06.823990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa07c6-91c5-4e90-902d-f12ccf43f388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:06.824290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa07c6-91c5-4e90-902d-f12ccf43f388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:06.825641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa07c6-91c5-4e90-902d-f12ccf43f388 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:06.838859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 473/938] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:06.844581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa07c6-91c5-4e90-902d-f12ccf43f388 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:06.867845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 466/939] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:06.894729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5de87-b854-48c4-ac09-72a5783f630f None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:06.957016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa07c6-91c5-4e90-902d-f12ccf43f388 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:06.996992 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba18a0-1972-4b19-808c-7b864021d52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:06.998200 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba18a0-1972-4b19-808c-7b864021d52b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:06.998488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba18a0-1972-4b19-808c-7b864021d52b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:06.998766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba18a0-1972-4b19-808c-7b864021d52b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:07.008079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba18a0-1972-4b19-808c-7b864021d52b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:07.009827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba18a0-1972-4b19-808c-7b864021d52b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:07.016764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5de87-b854-48c4-ac09-72a5783f630f None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-84ba18a0-1972-4b19-808c-7b864021d52b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:36:07.027923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:07.028860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:07.029787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:07.029787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:07.029787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:36:07.029787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:36:07.029787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:36:07.029787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:36:07.029787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:36:07.029787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:36:07.029787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:36:07.029787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:07.037143 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 474/940] 10.222.0.72 () {56 vars in 1117 bytes} [Mon May 16 18:36:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:07.038201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba18a0-1972-4b19-808c-7b864021d52b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:07.058673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadffba-03d2-4fa9-bade-4b225e60467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:07.059348 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadffba-03d2-4fa9-bade-4b225e60467c None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:07.059632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadffba-03d2-4fa9-bade-4b225e60467c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:07.061736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadffba-03d2-4fa9-bade-4b225e60467c None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:07.062920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadffba-03d2-4fa9-bade-4b225e60467c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:07.064682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadffba-03d2-4fa9-bade-4b225e60467c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:07.066555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: WARNING keystone.server.flask.common [None req-0dadffba-03d2-4fa9-bade-4b225e60467c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 18:36:07.089408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.sql.core [None req-0dadffba-03d2-4fa9-bade-4b225e60467c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 18:36:07.089408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 18:36:07.089408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [parameters: {'id': 'bd948ec7aa184ab8b2174a3a9554ab4e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 18:36:07.089408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91825) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-0dadffba-03d2-4fa9-bade-4b225e60467c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd948ec7aa184ab8b2174a3a9554ab4e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd948ec7aa184ab8b2174a3a9554ab4e. May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application conn.query(q) May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:36:07.099535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result.read() May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 16 18:36:07.100397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return project_ref.to_dict() May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application next(self.gen) May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application yield resource May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application next(self.gen) May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.session.rollback() May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.force_reraise() May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise self.value May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application session.commit() May 16 18:36:07.101352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._prepare_impl() May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.session.flush() May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._flush(objects) May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application compat.raise_( May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application flush_context.execute() May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 18:36:07.102232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rec.execute(self) May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 18:36:07.105235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application conn.query(q) May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result.read() May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:36:07.107151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [parameters: {'id': 'bd948ec7aa184ab8b2174a3a9554ab4e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:07.109284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:07.111140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:07.113664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:07.113664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 16 18:36:07.113664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 16 18:36:07.113664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:07.113664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:07.113664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 16 18:36:07.113664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.Conflict( May 16 18:36:07.113664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd948ec7aa184ab8b2174a3a9554ab4e. May 16 18:36:07.113664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:07.113664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 467/941] 10.222.0.72 () {60 vars in 1140 bytes} [Mon May 16 18:36:06 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:07.113664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadffba-03d2-4fa9-bade-4b225e60467c None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:07.160125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba18a0-1972-4b19-808c-7b864021d52b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:07.195555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c97413-fe62-4aa5-ad97-69608c21cd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:07.197333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c97413-fe62-4aa5-ad97-69608c21cd7a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:07.197876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c97413-fe62-4aa5-ad97-69608c21cd7a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:07.198358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c97413-fe62-4aa5-ad97-69608c21cd7a None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:07.199404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c97413-fe62-4aa5-ad97-69608c21cd7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:07.199945 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c97413-fe62-4aa5-ad97-69608c21cd7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:07.201643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c97413-fe62-4aa5-ad97-69608c21cd7a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:07.225436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 475/942] 10.222.0.72 () {56 vars in 1149 bytes} [Mon May 16 18:36:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:07.226635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c97413-fe62-4aa5-ad97-69608c21cd7a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:07.227380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadffba-03d2-4fa9-bade-4b225e60467c None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:07.266092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c9de1-bd3c-4333-ba8e-e4752e77c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:07.266904 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c9de1-bd3c-4333-ba8e-e4752e77c323 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:07.267186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c9de1-bd3c-4333-ba8e-e4752e77c323 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:07.267462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c9de1-bd3c-4333-ba8e-e4752e77c323 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:07.275043 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c9de1-bd3c-4333-ba8e-e4752e77c323 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:07.276745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c9de1-bd3c-4333-ba8e-e4752e77c323 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-344c9de1-bd3c-4333-ba8e-e4752e77c323 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:36:07.290867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:07.291871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:07.292757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:36:07.292757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:36:07.292757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:36:07.292757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:36:07.292757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:36:07.292757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:36:07.292757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:07.292757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:07.297092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 468/943] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:07.297961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c9de1-bd3c-4333-ba8e-e4752e77c323 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:07.339659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c97413-fe62-4aa5-ad97-69608c21cd7a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:07.376214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb216fe-0ea0-46a8-a097-5243fe930097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:07.377942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb216fe-0ea0-46a8-a097-5243fe930097 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:07.378476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb216fe-0ea0-46a8-a097-5243fe930097 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:07.378946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb216fe-0ea0-46a8-a097-5243fe930097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:07.391057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb216fe-0ea0-46a8-a097-5243fe930097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:07.392859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb216fe-0ea0-46a8-a097-5243fe930097 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:07.403187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c9de1-bd3c-4333-ba8e-e4752e77c323 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-0fb216fe-0ea0-46a8-a097-5243fe930097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:07.411871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:07.412741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:07.413631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:07.413631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:07.413631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:07.413631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:07.420288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 476/944] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:07.421492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb216fe-0ea0-46a8-a097-5243fe930097 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:07.437345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74b4ec-26a7-434f-9f54-aaacd7abda3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:07.438097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74b4ec-26a7-434f-9f54-aaacd7abda3a None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:07.438297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74b4ec-26a7-434f-9f54-aaacd7abda3a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:07.438561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74b4ec-26a7-434f-9f54-aaacd7abda3a None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:07.439325 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74b4ec-26a7-434f-9f54-aaacd7abda3a None admin] RBAC: Adding query filter params (name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:07.439629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74b4ec-26a7-434f-9f54-aaacd7abda3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:07.441081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74b4ec-26a7-434f-9f54-aaacd7abda3a None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:07.467858 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 469/945] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:36:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:07.535434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb216fe-0ea0-46a8-a097-5243fe930097 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:07.577024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0a63e-7cd2-407e-9111-50bfe0844d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:07.578195 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0a63e-7cd2-407e-9111-50bfe0844d0e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:07.578728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0a63e-7cd2-407e-9111-50bfe0844d0e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:07.579216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0a63e-7cd2-407e-9111-50bfe0844d0e None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:07.580208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0a63e-7cd2-407e-9111-50bfe0844d0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:07.580719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0a63e-7cd2-407e-9111-50bfe0844d0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:07.582334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0a63e-7cd2-407e-9111-50bfe0844d0e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:07.596119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 477/946] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:07.607783 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74b4ec-26a7-434f-9f54-aaacd7abda3a None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:07.707730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74b4ec-26a7-434f-9f54-aaacd7abda3a None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:07.731394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1766b-b40d-453b-a048-5722b747925e None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:07.731763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1766b-b40d-453b-a048-5722b747925e None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:07.732002 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1766b-b40d-453b-a048-5722b747925e None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:07.734634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 478/947] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:07.738897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7de1b-b254-4fda-a566-bb7b365824c0 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:07.739404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7de1b-b254-4fda-a566-bb7b365824c0 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:07.739904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7de1b-b254-4fda-a566-bb7b365824c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:07.743584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07650b4-cb44-4ec0-8f4e-cc8c4c4d9f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:07.743927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07650b4-cb44-4ec0-8f4e-cc8c4c4d9f54 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:07.744281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07650b4-cb44-4ec0-8f4e-cc8c4c4d9f54 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:07.744625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07650b4-cb44-4ec0-8f4e-cc8c4c4d9f54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:07.752489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07650b4-cb44-4ec0-8f4e-cc8c4c4d9f54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:07.754034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07650b4-cb44-4ec0-8f4e-cc8c4c4d9f54 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:07.766117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-92e7de1b-b254-4fda-a566-bb7b365824c0 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:07.767454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-92e7de1b-b254-4fda-a566-bb7b365824c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-f07650b4-cb44-4ec0-8f4e-cc8c4c4d9f54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:36:07.769283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:07.770282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:07.771377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:36:07.771377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:36:07.771377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:36:07.771377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:36:07.771377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:36:07.771377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:36:07.771377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:07.771377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:07.773651 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 470/948] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:07.781275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07650b4-cb44-4ec0-8f4e-cc8c4c4d9f54 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:07.852237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 479/949] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:07.875854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7de1b-b254-4fda-a566-bb7b365824c0 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:07.889807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07650b4-cb44-4ec0-8f4e-cc8c4c4d9f54 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:07.924667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac1483-7182-4316-a924-604ba35f1c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:07.925426 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac1483-7182-4316-a924-604ba35f1c2d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:07.925629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac1483-7182-4316-a924-604ba35f1c2d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:07.925881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac1483-7182-4316-a924-604ba35f1c2d None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:07.926672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac1483-7182-4316-a924-604ba35f1c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:07.926979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac1483-7182-4316-a924-604ba35f1c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:07.928521 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac1483-7182-4316-a924-604ba35f1c2d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:07.947149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 471/950] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:07.948270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac1483-7182-4316-a924-604ba35f1c2d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:07.990050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7de1b-b254-4fda-a566-bb7b365824c0 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:08.029243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1300794-c2b0-4930-bf25-24c177d1e25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:08.030045 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300794-c2b0-4930-bf25-24c177d1e25a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:08.030328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300794-c2b0-4930-bf25-24c177d1e25a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:08.030600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300794-c2b0-4930-bf25-24c177d1e25a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:08.031258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1300794-c2b0-4930-bf25-24c177d1e25a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:08.032660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1300794-c2b0-4930-bf25-24c177d1e25a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-e1300794-c2b0-4930-bf25-24c177d1e25a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:08.044500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:08.045708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:08.051648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 480/951] 10.222.0.72 () {56 vars in 1126 bytes} [Mon May 16 18:36:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:08.052666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284f714-1276-409b-9510-5e63c58b42ca None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:08.052666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284f714-1276-409b-9510-5e63c58b42ca None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:08.052666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284f714-1276-409b-9510-5e63c58b42ca None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:08.052666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 481/952] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:08.053544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284f714-1276-409b-9510-5e63c58b42ca None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:08.059662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac1483-7182-4316-a924-604ba35f1c2d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:08.095811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f7296-a19e-423e-894a-b49b38a7cf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:08.096722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7296-a19e-423e-894a-b49b38a7cf07 None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:08.096982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7296-a19e-423e-894a-b49b38a7cf07 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:08.097250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7296-a19e-423e-894a-b49b38a7cf07 None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/213dd48e9a5d46dda298caf8cbffce9e/roles/be018b67ef8944b2959b4c5d0451f8cc` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:08.099537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f7296-a19e-423e-894a-b49b38a7cf07 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=213dd48e9a5d46dda298caf8cbffce9e, role_id=be018b67ef8944b2959b4c5d0451f8cc)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:08.100988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f7296-a19e-423e-894a-b49b38a7cf07 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:08.123744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 472/953] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:36:07 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/213dd48e9a5d46dda298caf8cbffce9e/roles/be018b67ef8944b2959b4c5d0451f8cc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:36:08.123744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1b24c-da2c-4ebb-a8e8-5fb531bb3b11 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:08.123744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1b24c-da2c-4ebb-a8e8-5fb531bb3b11 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:08.123744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1b24c-da2c-4ebb-a8e8-5fb531bb3b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:08.145988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-30d1b24c-da2c-4ebb-a8e8-5fb531bb3b11 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:08.148409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-30d1b24c-da2c-4ebb-a8e8-5fb531bb3b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:08.172307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284f714-1276-409b-9510-5e63c58b42ca None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:08.215557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d558f-e5f5-4173-aeb1-bc7809844c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:08.216393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d558f-e5f5-4173-aeb1-bc7809844c07 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:08.216743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d558f-e5f5-4173-aeb1-bc7809844c07 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:08.217081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d558f-e5f5-4173-aeb1-bc7809844c07 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:08.217874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d558f-e5f5-4173-aeb1-bc7809844c07 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:08.218492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d558f-e5f5-4173-aeb1-bc7809844c07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:08.220794 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d558f-e5f5-4173-aeb1-bc7809844c07 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:08.228871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 482/954] 10.222.0.72 () {56 vars in 1122 bytes} [Mon May 16 18:36:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:08.233433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 473/955] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:08.236905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d558f-e5f5-4173-aeb1-bc7809844c07 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:08.260630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1b24c-da2c-4ebb-a8e8-5fb531bb3b11 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:08.365169 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d558f-e5f5-4173-aeb1-bc7809844c07 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:08.371479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1b24c-da2c-4ebb-a8e8-5fb531bb3b11 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:08.406645 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6d37c-1e84-4e11-9c83-c45ad879d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:08.407665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6d37c-1e84-4e11-9c83-c45ad879d740 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:08.407976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6d37c-1e84-4e11-9c83-c45ad879d740 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:08.408529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6d37c-1e84-4e11-9c83-c45ad879d740 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:08.409249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6d37c-1e84-4e11-9c83-c45ad879d740 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:08.409555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6d37c-1e84-4e11-9c83-c45ad879d740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:08.411403 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6d37c-1e84-4e11-9c83-c45ad879d740 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:08.419267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 483/956] 10.222.0.72 () {56 vars in 1122 bytes} [Mon May 16 18:36:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:08.424811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6d37c-1e84-4e11-9c83-c45ad879d740 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:08.426458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9a813-63ab-4188-9d91-4725f48ca140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:08.427505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9a813-63ab-4188-9d91-4725f48ca140 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:08.427889 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9a813-63ab-4188-9d91-4725f48ca140 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:08.429104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9a813-63ab-4188-9d91-4725f48ca140 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:08.429844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9a813-63ab-4188-9d91-4725f48ca140 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:08.431790 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9a813-63ab-4188-9d91-4725f48ca140 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-8ca9a813-63ab-4188-9d91-4725f48ca140 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:08.447657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:08.448945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:08.450010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 474/957] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:36:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:08.456279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9a813-63ab-4188-9d91-4725f48ca140 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:08.544197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6d37c-1e84-4e11-9c83-c45ad879d740 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:08.561782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9a813-63ab-4188-9d91-4725f48ca140 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:08.577915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d585ea4-518e-4d32-bb57-e85147d23ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:08.578579 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d585ea4-518e-4d32-bb57-e85147d23ca2 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:08.578854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d585ea4-518e-4d32-bb57-e85147d23ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:08.579125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d585ea4-518e-4d32-bb57-e85147d23ca2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:08.580035 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d585ea4-518e-4d32-bb57-e85147d23ca2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:08.581388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d585ea4-518e-4d32-bb57-e85147d23ca2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:08.601606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2678c-0f83-437e-81ae-765ce657de8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:08.602968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2678c-0f83-437e-81ae-765ce657de8c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:08.603527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2678c-0f83-437e-81ae-765ce657de8c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:08.603906 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2678c-0f83-437e-81ae-765ce657de8c None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:08.604695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2678c-0f83-437e-81ae-765ce657de8c None admin] RBAC: Adding query filter params (name=compute) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:08.605142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2678c-0f83-437e-81ae-765ce657de8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:08.606668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2678c-0f83-437e-81ae-765ce657de8c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:08.608210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 484/958] 10.222.0.72 () {60 vars in 1144 bytes} [Mon May 16 18:36:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:36:08.612684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 475/959] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:36:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:08.618235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d585ea4-518e-4d32-bb57-e85147d23ca2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:08.742753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d585ea4-518e-4d32-bb57-e85147d23ca2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:08.780217 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078f80d-63e6-4adf-bac9-0d58d1380f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:08.780897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078f80d-63e6-4adf-bac9-0d58d1380f44 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:08.781175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078f80d-63e6-4adf-bac9-0d58d1380f44 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:08.781446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078f80d-63e6-4adf-bac9-0d58d1380f44 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:08.782169 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078f80d-63e6-4adf-bac9-0d58d1380f44 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:08.782471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078f80d-63e6-4adf-bac9-0d58d1380f44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:08.783880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078f80d-63e6-4adf-bac9-0d58d1380f44 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:08.789359 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 485/960] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:36:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:09.834217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17ed3f-108a-4858-aad4-186c1c927b1d None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:09.835221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17ed3f-108a-4858-aad4-186c1c927b1d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:09.835653 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17ed3f-108a-4858-aad4-186c1c927b1d None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:09.837819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 476/961] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:09.844082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1324acd-24be-400a-af17-40c7495e6b64 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:09.844873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1324acd-24be-400a-af17-40c7495e6b64 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:09.845300 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1324acd-24be-400a-af17-40c7495e6b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:09.862641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-e1324acd-24be-400a-af17-40c7495e6b64 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:09.864095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e1324acd-24be-400a-af17-40c7495e6b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:09.939877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 486/962] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:09.958689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17ed3f-108a-4858-aad4-186c1c927b1d None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:10.065372 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17ed3f-108a-4858-aad4-186c1c927b1d None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:10.101273 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c346469-9485-42b5-8a84-1609da0d4445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:10.101874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346469-9485-42b5-8a84-1609da0d4445 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:10.102155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346469-9485-42b5-8a84-1609da0d4445 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:10.103108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346469-9485-42b5-8a84-1609da0d4445 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:10.103886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c346469-9485-42b5-8a84-1609da0d4445 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:10.105324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c346469-9485-42b5-8a84-1609da0d4445 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:10.120851 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.sql.core [None req-9c346469-9485-42b5-8a84-1609da0d4445 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 18:36:10.120851 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 18:36:10.120851 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [parameters: {'user_id': '1dc6d569d999435baea1832b4e81d6fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 18:36:10.120851 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91825) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-9c346469-9485-42b5-8a84-1609da0d4445 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application conn.query(q) May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result.read() May 16 18:36:10.128876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:36:10.129730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application next(self.gen) May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application yield resource May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application next(self.gen) May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.session.rollback() May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.force_reraise() May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise self.value May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application session.commit() May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 18:36:10.130637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._prepare_impl() May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.session.flush() May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._flush(objects) May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application compat.raise_( May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application flush_context.execute() May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rec.execute(self) May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 18:36:10.131504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result = connection._execute_20( May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 18:36:10.134073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result = self._query(query) May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application conn.query(q) May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application result.read() May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 18:36:10.136321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [parameters: {'user_id': '1dc6d569d999435baea1832b4e81d6fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:10.138354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 16 18:36:10.147959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 16 18:36:10.150266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 16 18:36:10.150266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 16 18:36:10.150266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 18:36:10.150266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 18:36:10.150266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 18:36:10.150266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:10.150266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 477/963] 10.222.0.72 () {60 vars in 1131 bytes} [Mon May 16 18:36:09 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:10.151221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1324acd-24be-400a-af17-40c7495e6b64 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:10.238235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1324acd-24be-400a-af17-40c7495e6b64 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:10.272877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77222a2b-033c-4956-9e8c-3f2e2ca318e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:10.273679 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77222a2b-033c-4956-9e8c-3f2e2ca318e1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:10.273962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77222a2b-033c-4956-9e8c-3f2e2ca318e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:10.274394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77222a2b-033c-4956-9e8c-3f2e2ca318e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:10.282308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77222a2b-033c-4956-9e8c-3f2e2ca318e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:10.283901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77222a2b-033c-4956-9e8c-3f2e2ca318e1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-77222a2b-033c-4956-9e8c-3f2e2ca318e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:36:10.301025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:10.302678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:10.304214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:10.304214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:10.304214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:36:10.304214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:36:10.304214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:36:10.304214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:36:10.304214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:36:10.304214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:36:10.304214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 18:36:10.304214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:10.307607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 487/964] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:36:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:10.309495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c346469-9485-42b5-8a84-1609da0d4445 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:10.416505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c346469-9485-42b5-8a84-1609da0d4445 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:10.451688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a7a2b-d46e-4949-9cc1-5358bdeb7db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:10.452400 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a7a2b-d46e-4949-9cc1-5358bdeb7db7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:10.452733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a7a2b-d46e-4949-9cc1-5358bdeb7db7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:10.453023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a7a2b-d46e-4949-9cc1-5358bdeb7db7 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:10.453843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a7a2b-d46e-4949-9cc1-5358bdeb7db7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:10.454149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a7a2b-d46e-4949-9cc1-5358bdeb7db7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:10.455812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a7a2b-d46e-4949-9cc1-5358bdeb7db7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:10.492796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e5167-c38a-4b13-b94c-0fded7eabcbd None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:10.492796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e5167-c38a-4b13-b94c-0fded7eabcbd None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:10.492796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e5167-c38a-4b13-b94c-0fded7eabcbd None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:10.494143 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 488/965] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:10.498333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 478/966] 10.222.0.72 () {56 vars in 1101 bytes} [Mon May 16 18:36:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:10.499995 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa941603-5c0b-4ba8-a5d8-acb1b994ac44 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:10.500280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa941603-5c0b-4ba8-a5d8-acb1b994ac44 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:10.500553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa941603-5c0b-4ba8-a5d8-acb1b994ac44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:10.531871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-aa941603-5c0b-4ba8-a5d8-acb1b994ac44 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:10.533098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-aa941603-5c0b-4ba8-a5d8-acb1b994ac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:10.609738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 489/967] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:10.634559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a7a2b-d46e-4949-9cc1-5358bdeb7db7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:10.745959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a7a2b-d46e-4949-9cc1-5358bdeb7db7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:10.784048 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdeb44-1bbb-4daf-af60-6c5afbe38247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:10.784987 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdeb44-1bbb-4daf-af60-6c5afbe38247 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:10.785347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdeb44-1bbb-4daf-af60-6c5afbe38247 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:10.785691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdeb44-1bbb-4daf-af60-6c5afbe38247 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:10.797482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdeb44-1bbb-4daf-af60-6c5afbe38247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-e3cdeb44-1bbb-4daf-af60-6c5afbe38247 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:10.806115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:10.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:10.808926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:10.809683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 479/968] 10.222.0.72 () {56 vars in 1120 bytes} [Mon May 16 18:36:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:10.817880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa941603-5c0b-4ba8-a5d8-acb1b994ac44 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:10.919803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa941603-5c0b-4ba8-a5d8-acb1b994ac44 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:10.950547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c56828-7cb4-47a2-ab7d-0dd272a9300c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:10.951112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c56828-7cb4-47a2-ab7d-0dd272a9300c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:10.951206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c56828-7cb4-47a2-ab7d-0dd272a9300c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:10.952851 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 480/969] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:10.957668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8624ce3-9718-45db-bc81-b49bfdbdda92 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:10.957957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8624ce3-9718-45db-bc81-b49bfdbdda92 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:10.958236 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8624ce3-9718-45db-bc81-b49bfdbdda92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:10.959077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f15898-4690-47d3-98c9-4945ba890708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:10.959769 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f15898-4690-47d3-98c9-4945ba890708 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:10.960049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f15898-4690-47d3-98c9-4945ba890708 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:10.960319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f15898-4690-47d3-98c9-4945ba890708 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:10.961068 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f15898-4690-47d3-98c9-4945ba890708 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:10.961368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f15898-4690-47d3-98c9-4945ba890708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:10.963369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f15898-4690-47d3-98c9-4945ba890708 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:10.971849 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 490/970] 10.222.0.72 () {56 vars in 1115 bytes} [Mon May 16 18:36:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:10.976878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f8624ce3-9718-45db-bc81-b49bfdbdda92 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:10.977118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f15898-4690-47d3-98c9-4945ba890708 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:10.978678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f8624ce3-9718-45db-bc81-b49bfdbdda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:11.044852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 481/971] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:11.066913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8624ce3-9718-45db-bc81-b49bfdbdda92 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:11.083363 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f15898-4690-47d3-98c9-4945ba890708 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:11.121241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79006a-f344-43cd-aa16-580d7bb74604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:11.122031 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79006a-f344-43cd-aa16-580d7bb74604 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.122309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79006a-f344-43cd-aa16-580d7bb74604 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.122580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79006a-f344-43cd-aa16-580d7bb74604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.132928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79006a-f344-43cd-aa16-580d7bb74604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:11.135381 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79006a-f344-43cd-aa16-580d7bb74604 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-9f79006a-f344-43cd-aa16-580d7bb74604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:11.152865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:11.153924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:11.154838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:11.154838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:11.154838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:11.154838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:11.154838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 491/972] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:11.155574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28927b-2658-47ed-b688-8e6c2480524d None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.155888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28927b-2658-47ed-b688-8e6c2480524d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.156170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28927b-2658-47ed-b688-8e6c2480524d None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.157549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 492/973] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:11.159531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28927b-2658-47ed-b688-8e6c2480524d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:11.168335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8624ce3-9718-45db-bc81-b49bfdbdda92 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:11.201540 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae31fc9-606c-4381-b2a1-d7dc02845e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:11.202331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae31fc9-606c-4381-b2a1-d7dc02845e72 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.202611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae31fc9-606c-4381-b2a1-d7dc02845e72 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.202882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae31fc9-606c-4381-b2a1-d7dc02845e72 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.203532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae31fc9-606c-4381-b2a1-d7dc02845e72 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:11.204923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae31fc9-606c-4381-b2a1-d7dc02845e72 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-5ae31fc9-606c-4381-b2a1-d7dc02845e72 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:11.216585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:11.217679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:11.218812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 482/974] 10.222.0.72 () {56 vars in 1126 bytes} [Mon May 16 18:36:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:11.219651 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5ae2-76eb-4622-9f65-37158bc2801a None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.219763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5ae2-76eb-4622-9f65-37158bc2801a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.219994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5ae2-76eb-4622-9f65-37158bc2801a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.235529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b14d5ae2-76eb-4622-9f65-37158bc2801a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:11.236729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b14d5ae2-76eb-4622-9f65-37158bc2801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:11.263348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28927b-2658-47ed-b688-8e6c2480524d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:11.294342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a310eac-511d-489f-bc06-1571b5b99d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:11.295049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a310eac-511d-489f-bc06-1571b5b99d68 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.295398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a310eac-511d-489f-bc06-1571b5b99d68 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.295673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a310eac-511d-489f-bc06-1571b5b99d68 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.296418 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a310eac-511d-489f-bc06-1571b5b99d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:11.296721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a310eac-511d-489f-bc06-1571b5b99d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:11.298071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a310eac-511d-489f-bc06-1571b5b99d68 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:11.299415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 483/975] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:11.303775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5ae2-76eb-4622-9f65-37158bc2801a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:11.311862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 493/976] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:11.316552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a310eac-511d-489f-bc06-1571b5b99d68 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:11.402104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5ae2-76eb-4622-9f65-37158bc2801a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:11.412372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a310eac-511d-489f-bc06-1571b5b99d68 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:11.434055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd58e2-9011-455f-9b30-0a07c47fff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:11.434717 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd58e2-9011-455f-9b30-0a07c47fff3f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.435000 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd58e2-9011-455f-9b30-0a07c47fff3f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.435277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd58e2-9011-455f-9b30-0a07c47fff3f None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.436016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd58e2-9011-455f-9b30-0a07c47fff3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:11.436318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd58e2-9011-455f-9b30-0a07c47fff3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:11.437674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd58e2-9011-455f-9b30-0a07c47fff3f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:11.442651 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 484/977] 10.222.0.72 () {56 vars in 1122 bytes} [Mon May 16 18:36:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:11.443393 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd58e2-9011-455f-9b30-0a07c47fff3f None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:11.449252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcfb8f-85c1-4b19-ac61-02115711b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:11.450105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcfb8f-85c1-4b19-ac61-02115711b733 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.450383 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcfb8f-85c1-4b19-ac61-02115711b733 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.450652 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcfb8f-85c1-4b19-ac61-02115711b733 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.457891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcfb8f-85c1-4b19-ac61-02115711b733 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:11.459310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcfb8f-85c1-4b19-ac61-02115711b733 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-c3fcfb8f-85c1-4b19-ac61-02115711b733 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:36:11.475226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:11.476239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:11.477170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:11.477170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:11.477170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:36:11.477170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:36:11.477170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:36:11.477170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:36:11.477170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:36:11.477170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:36:11.477170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 18:36:11.477170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:11.477170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 494/978] 10.222.0.72 () {56 vars in 1117 bytes} [Mon May 16 18:36:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:11.478888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcfb8f-85c1-4b19-ac61-02115711b733 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:11.539221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd58e2-9011-455f-9b30-0a07c47fff3f None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:11.569736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcfb8f-85c1-4b19-ac61-02115711b733 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:11.570527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecd863-7b94-4de8-b8e5-d63520d4ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:11.571702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecd863-7b94-4de8-b8e5-d63520d4ac31 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.572005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecd863-7b94-4de8-b8e5-d63520d4ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.572279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecd863-7b94-4de8-b8e5-d63520d4ac31 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.573009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecd863-7b94-4de8-b8e5-d63520d4ac31 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:11.574365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecd863-7b94-4de8-b8e5-d63520d4ac31 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:11.587377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 485/979] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:36:11 2022] POST /identity/v3/services => generated 242 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:36:11.588218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecd863-7b94-4de8-b8e5-d63520d4ac31 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:11.614146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e96d2-eae2-413e-825f-4aca3fa940db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:11.614841 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e96d2-eae2-413e-825f-4aca3fa940db None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.615123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e96d2-eae2-413e-825f-4aca3fa940db None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.615740 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e96d2-eae2-413e-825f-4aca3fa940db None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.616167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e96d2-eae2-413e-825f-4aca3fa940db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:11.616474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e96d2-eae2-413e-825f-4aca3fa940db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:11.618521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e96d2-eae2-413e-825f-4aca3fa940db None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:11.623921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 495/980] 10.222.0.72 () {56 vars in 1122 bytes} [Mon May 16 18:36:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:11.629989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e96d2-eae2-413e-825f-4aca3fa940db None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:11.702288 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecd863-7b94-4de8-b8e5-d63520d4ac31 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:11.736295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e96d2-eae2-413e-825f-4aca3fa940db None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:11.745108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be8f2c-38ff-4bd5-a8a0-b1ed389affbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:11.745903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be8f2c-38ff-4bd5-a8a0-b1ed389affbe None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.746283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be8f2c-38ff-4bd5-a8a0-b1ed389affbe None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.746567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be8f2c-38ff-4bd5-a8a0-b1ed389affbe None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.747434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be8f2c-38ff-4bd5-a8a0-b1ed389affbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:11.747775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be8f2c-38ff-4bd5-a8a0-b1ed389affbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:11.749352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be8f2c-38ff-4bd5-a8a0-b1ed389affbe None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:11.768511 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 486/981] 10.222.0.72 () {56 vars in 1149 bytes} [Mon May 16 18:36:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:11.774162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be8f2c-38ff-4bd5-a8a0-b1ed389affbe None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:11.777826 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5b8d1-97f3-46f2-a88f-31f855904108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:11.778499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b8d1-97f3-46f2-a88f-31f855904108 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.778777 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b8d1-97f3-46f2-a88f-31f855904108 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.779047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b8d1-97f3-46f2-a88f-31f855904108 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.780297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5b8d1-97f3-46f2-a88f-31f855904108 None admin] RBAC: Adding query filter params (interface=admin, service_id=4e5e0b1b4558490fb05d3842f939b9ce, region_id=RegionOne) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:11.780297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5b8d1-97f3-46f2-a88f-31f855904108 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:11.782144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5b8d1-97f3-46f2-a88f-31f855904108 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:11.787151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 496/982] 10.222.0.72 () {56 vars in 1249 bytes} [Mon May 16 18:36:11 2022] GET /identity/v3/endpoints?service_id=4e5e0b1b4558490fb05d3842f939b9ce&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:11.792908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5b8d1-97f3-46f2-a88f-31f855904108 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:11.885234 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be8f2c-38ff-4bd5-a8a0-b1ed389affbe None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:11.890118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5b8d1-97f3-46f2-a88f-31f855904108 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:11.920861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77744145-80f4-4a6d-991e-294b0ed1af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:11.921580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744145-80f4-4a6d-991e-294b0ed1af89 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.921861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744145-80f4-4a6d-991e-294b0ed1af89 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.922165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744145-80f4-4a6d-991e-294b0ed1af89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.925348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86990e-d64f-478c-862c-03179fe5f174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:11.926131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86990e-d64f-478c-862c-03179fe5f174 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:11.926471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86990e-d64f-478c-862c-03179fe5f174 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:11.926750 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86990e-d64f-478c-862c-03179fe5f174 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:11.927460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86990e-d64f-478c-862c-03179fe5f174 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:11.928860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86990e-d64f-478c-862c-03179fe5f174 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:11.937238 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 497/983] 10.222.0.72 () {56 vars in 1087 bytes} [Mon May 16 18:36:11 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:36:11.997882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77744145-80f4-4a6d-991e-294b0ed1af89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:12.000014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77744145-80f4-4a6d-991e-294b0ed1af89 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:12.104266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 487/984] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:11 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:36:12.109908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86990e-d64f-478c-862c-03179fe5f174 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:12.209834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86990e-d64f-478c-862c-03179fe5f174 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:12.243091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f9ba0-0de9-45c7-bb8e-6c56d74363db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:12.243985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9ba0-0de9-45c7-bb8e-6c56d74363db None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:12.244269 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9ba0-0de9-45c7-bb8e-6c56d74363db None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:12.244541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9ba0-0de9-45c7-bb8e-6c56d74363db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:12.254125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f9ba0-0de9-45c7-bb8e-6c56d74363db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:12.255554 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f9ba0-0de9-45c7-bb8e-6c56d74363db None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-d74f9ba0-0de9-45c7-bb8e-6c56d74363db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:12.272904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:12.273785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:12.275340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:12.275340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:12.275340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:12.275340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:12.275340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 498/985] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:12.280369 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77744145-80f4-4a6d-991e-294b0ed1af89 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:12.379413 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77744145-80f4-4a6d-991e-294b0ed1af89 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:12.412170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0363-136f-46f2-bf0b-750f24e6504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:12.412842 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0363-136f-46f2-bf0b-750f24e6504e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:12.413130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0363-136f-46f2-bf0b-750f24e6504e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:12.413400 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0363-136f-46f2-bf0b-750f24e6504e None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:12.414126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e0363-136f-46f2-bf0b-750f24e6504e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:12.414432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e0363-136f-46f2-bf0b-750f24e6504e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:12.416722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e0363-136f-46f2-bf0b-750f24e6504e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:12.432365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 488/986] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:12.434250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f9ba0-0de9-45c7-bb8e-6c56d74363db None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:12.529167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f9ba0-0de9-45c7-bb8e-6c56d74363db None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:12.561647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eb706-aa04-4faa-af34-465ce12c2937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:12.562433 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb706-aa04-4faa-af34-465ce12c2937 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:12.562710 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb706-aa04-4faa-af34-465ce12c2937 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:12.562980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb706-aa04-4faa-af34-465ce12c2937 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:12.569392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eb706-aa04-4faa-af34-465ce12c2937 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:12.570815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eb706-aa04-4faa-af34-465ce12c2937 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-925eb706-aa04-4faa-af34-465ce12c2937 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:36:12.584079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:12.585141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:12.586246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:36:12.586246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:36:12.586246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:36:12.586246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:36:12.586246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:36:12.586246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:36:12.586246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:12.586246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:12.586246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 499/987] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:12.592541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0363-136f-46f2-bf0b-750f24e6504e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:12.688189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0363-136f-46f2-bf0b-750f24e6504e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:12.722295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1fa00-2b75-457b-8fc2-296391286c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:12.722961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fa00-2b75-457b-8fc2-296391286c21 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:12.723244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fa00-2b75-457b-8fc2-296391286c21 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:12.723518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fa00-2b75-457b-8fc2-296391286c21 None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:12.724343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1fa00-2b75-457b-8fc2-296391286c21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:12.724653 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1fa00-2b75-457b-8fc2-296391286c21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:12.726081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1fa00-2b75-457b-8fc2-296391286c21 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:12.745502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 489/988] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:12.746820 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eb706-aa04-4faa-af34-465ce12c2937 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:12.845612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eb706-aa04-4faa-af34-465ce12c2937 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:12.877514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0a65a-c342-48de-b6c2-9c7467937527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:12.878324 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a65a-c342-48de-b6c2-9c7467937527 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:12.878702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a65a-c342-48de-b6c2-9c7467937527 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:12.879077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a65a-c342-48de-b6c2-9c7467937527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:12.880072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0a65a-c342-48de-b6c2-9c7467937527 None admin] RBAC: Adding query filter params (role.id=be018b67ef8944b2959b4c5d0451f8cc, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=213dd48e9a5d46dda298caf8cbffce9e) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:12.880487 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0a65a-c342-48de-b6c2-9c7467937527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:12.882018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0a65a-c342-48de-b6c2-9c7467937527 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:12.895734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 500/989] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:36:12 2022] GET /identity/v3/role_assignments?user.id=213dd48e9a5d46dda298caf8cbffce9e&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=be018b67ef8944b2959b4c5d0451f8cc => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:13.860671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165cfd0-0c2a-4ac8-b830-646ca9cdcefd None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:13.861239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165cfd0-0c2a-4ac8-b830-646ca9cdcefd None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:13.861239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165cfd0-0c2a-4ac8-b830-646ca9cdcefd None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:13.862614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 490/990] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:13.867679 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd4e1-992c-46c4-af66-2f9893281cdd None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:13.868179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd4e1-992c-46c4-af66-2f9893281cdd None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:13.868361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd4e1-992c-46c4-af66-2f9893281cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:13.885812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-78bdd4e1-992c-46c4-af66-2f9893281cdd None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:13.886970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-78bdd4e1-992c-46c4-af66-2f9893281cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:13.955839 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 501/991] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:13.985934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165cfd0-0c2a-4ac8-b830-646ca9cdcefd None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:14.089156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165cfd0-0c2a-4ac8-b830-646ca9cdcefd None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:14.122549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aaae0-9825-4906-8452-2b3db6a55dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:14.123348 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aaae0-9825-4906-8452-2b3db6a55dcd None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:14.123629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aaae0-9825-4906-8452-2b3db6a55dcd None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:14.123933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aaae0-9825-4906-8452-2b3db6a55dcd None admin] PATH_INFO: `/v3/services/compute` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:14.124582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256aaae0-9825-4906-8452-2b3db6a55dcd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:14.125934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256aaae0-9825-4906-8452-2b3db6a55dcd None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-256aaae0-9825-4906-8452-2b3db6a55dcd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:14.137880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:14.138920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:36:14.140294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:14.141397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 491/992] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:36:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:14.145018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdd4e1-992c-46c4-af66-2f9893281cdd None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:14.210618 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b43df-471c-4772-a16f-241d0fbba1d8 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:14.210997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b43df-471c-4772-a16f-241d0fbba1d8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:14.211207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b43df-471c-4772-a16f-241d0fbba1d8 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:14.212986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 492/993] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:14.218289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e7118-39f3-4411-9461-0c6f557c3880 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:14.218579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e7118-39f3-4411-9461-0c6f557c3880 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:14.218860 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e7118-39f3-4411-9461-0c6f557c3880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:14.235278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-487e7118-39f3-4411-9461-0c6f557c3880 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:14.236485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-487e7118-39f3-4411-9461-0c6f557c3880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:14.244455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdd4e1-992c-46c4-af66-2f9893281cdd None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:14.277873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cbf9c-bfe8-414a-8c60-36a708022df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:14.278539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cbf9c-bfe8-414a-8c60-36a708022df0 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:14.278818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cbf9c-bfe8-414a-8c60-36a708022df0 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:14.279088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cbf9c-bfe8-414a-8c60-36a708022df0 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:14.279822 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cbf9c-bfe8-414a-8c60-36a708022df0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:14.280126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cbf9c-bfe8-414a-8c60-36a708022df0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:14.281479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cbf9c-bfe8-414a-8c60-36a708022df0 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:14.286572 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 502/994] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:36:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:14.291842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cbf9c-bfe8-414a-8c60-36a708022df0 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:14.302963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 493/995] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:14.326237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e7118-39f3-4411-9461-0c6f557c3880 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:14.388663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cbf9c-bfe8-414a-8c60-36a708022df0 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:14.421926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1e6aa-f856-4294-b835-2b15f7cc126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:14.422600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1e6aa-f856-4294-b835-2b15f7cc126b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:14.422884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1e6aa-f856-4294-b835-2b15f7cc126b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:14.423165 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1e6aa-f856-4294-b835-2b15f7cc126b None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:14.424026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1e6aa-f856-4294-b835-2b15f7cc126b None admin] RBAC: Adding query filter params (type=compute) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:14.424335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1e6aa-f856-4294-b835-2b15f7cc126b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:14.425624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e7118-39f3-4411-9461-0c6f557c3880 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:14.425728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1e6aa-f856-4294-b835-2b15f7cc126b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:14.431284 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 503/996] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:36:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:14.437607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1e6aa-f856-4294-b835-2b15f7cc126b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:14.461072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33984247-ab6c-41cd-98ee-b845404c30e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:14.462039 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33984247-ab6c-41cd-98ee-b845404c30e7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:14.462322 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33984247-ab6c-41cd-98ee-b845404c30e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:14.462596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33984247-ab6c-41cd-98ee-b845404c30e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:14.463251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33984247-ab6c-41cd-98ee-b845404c30e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:14.464635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33984247-ab6c-41cd-98ee-b845404c30e7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-33984247-ab6c-41cd-98ee-b845404c30e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:14.476920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:14.478937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:14.481098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 494/997] 10.222.0.72 () {56 vars in 1126 bytes} [Mon May 16 18:36:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:14.484650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33984247-ab6c-41cd-98ee-b845404c30e7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:14.540598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1e6aa-f856-4294-b835-2b15f7cc126b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:14.574685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9994851-6481-433f-83a2-79375fbef431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:14.575341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9994851-6481-433f-83a2-79375fbef431 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:14.575618 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9994851-6481-433f-83a2-79375fbef431 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:14.576042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9994851-6481-433f-83a2-79375fbef431 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:14.576835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9994851-6481-433f-83a2-79375fbef431 None admin] RBAC: Adding query filter params (interface=public, service_id=d5e512035cc84366850a68379302f411, region_id=RegionOne) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:14.577142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9994851-6481-433f-83a2-79375fbef431 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:14.578486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9994851-6481-433f-83a2-79375fbef431 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:14.583679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33984247-ab6c-41cd-98ee-b845404c30e7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:14.583827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 504/998] 10.222.0.72 () {56 vars in 1251 bytes} [Mon May 16 18:36:14 2022] GET /identity/v3/endpoints?service_id=d5e512035cc84366850a68379302f411&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:14.589201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9994851-6481-433f-83a2-79375fbef431 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:14.617303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28a81d-411c-448e-960a-9e2041d2471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:14.618790 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28a81d-411c-448e-960a-9e2041d2471b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:14.619175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28a81d-411c-448e-960a-9e2041d2471b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:14.619554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28a81d-411c-448e-960a-9e2041d2471b None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:14.620425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28a81d-411c-448e-960a-9e2041d2471b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:14.620855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28a81d-411c-448e-960a-9e2041d2471b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:14.622327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28a81d-411c-448e-960a-9e2041d2471b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:14.632010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 495/999] 10.222.0.72 () {56 vars in 1122 bytes} [Mon May 16 18:36:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:14.633005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28a81d-411c-448e-960a-9e2041d2471b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:14.685283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9994851-6481-433f-83a2-79375fbef431 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:14.718951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31d029-054a-49fc-ab2a-81bfa0ee5769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:14.719897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31d029-054a-49fc-ab2a-81bfa0ee5769 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:14.720369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31d029-054a-49fc-ab2a-81bfa0ee5769 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:14.720802 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31d029-054a-49fc-ab2a-81bfa0ee5769 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:14.721483 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31d029-054a-49fc-ab2a-81bfa0ee5769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:14.722840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31d029-054a-49fc-ab2a-81bfa0ee5769 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:14.730106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 505/1000] 10.222.0.72 () {56 vars in 1087 bytes} [Mon May 16 18:36:14 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:36:14.738292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28a81d-411c-448e-960a-9e2041d2471b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:14.778664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b259b-da41-457f-860d-fca52775ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:14.779342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b259b-da41-457f-860d-fca52775ac20 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:14.779652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b259b-da41-457f-860d-fca52775ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:14.779946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b259b-da41-457f-860d-fca52775ac20 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:14.780674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b259b-da41-457f-860d-fca52775ac20 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:14.780977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b259b-da41-457f-860d-fca52775ac20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:14.782355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b259b-da41-457f-860d-fca52775ac20 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:14.793281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 496/1001] 10.222.0.72 () {56 vars in 1122 bytes} [Mon May 16 18:36:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:14.794409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31d029-054a-49fc-ab2a-81bfa0ee5769 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:14.898435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31d029-054a-49fc-ab2a-81bfa0ee5769 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:14.935345 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82156aaf-362a-4c04-9a67-b2ead4713a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:14.936048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82156aaf-362a-4c04-9a67-b2ead4713a55 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:14.936327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82156aaf-362a-4c04-9a67-b2ead4713a55 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:14.936653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82156aaf-362a-4c04-9a67-b2ead4713a55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:14.937411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82156aaf-362a-4c04-9a67-b2ead4713a55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:14.938803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82156aaf-362a-4c04-9a67-b2ead4713a55 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:14.954445 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 506/1002] 10.222.0.72 () {60 vars in 1144 bytes} [Mon May 16 18:36:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:36:15.185430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f889f-d7a0-4915-878f-d957ce06c145 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:15.186110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f889f-d7a0-4915-878f-d957ce06c145 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:15.186110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f889f-d7a0-4915-878f-d957ce06c145 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:15.187406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 497/1003] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:15.192574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368d309-da0a-41f3-bed1-50a33e0dfc32 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:15.192867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368d309-da0a-41f3-bed1-50a33e0dfc32 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:15.193146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368d309-da0a-41f3-bed1-50a33e0dfc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:15.210352 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-0368d309-da0a-41f3-bed1-50a33e0dfc32 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:15.212069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0368d309-da0a-41f3-bed1-50a33e0dfc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:15.285190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 507/1004] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:15.307290 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f889f-d7a0-4915-878f-d957ce06c145 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:15.411584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f889f-d7a0-4915-878f-d957ce06c145 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:15.443579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbae434-bb65-4674-adc3-b919fb9934ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:15.444327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae434-bb65-4674-adc3-b919fb9934ce None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:15.444613 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae434-bb65-4674-adc3-b919fb9934ce None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:15.444982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae434-bb65-4674-adc3-b919fb9934ce None admin] PATH_INFO: `/v3/services/image` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:15.445543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbae434-bb65-4674-adc3-b919fb9934ce None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:15.447650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbae434-bb65-4674-adc3-b919fb9934ce None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-acbae434-bb65-4674-adc3-b919fb9934ce None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:15.459044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:15.460081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:36:15.460953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:15.463833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 498/1005] 10.222.0.72 () {56 vars in 1105 bytes} [Mon May 16 18:36:15 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:15.467155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368d309-da0a-41f3-bed1-50a33e0dfc32 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:15.564938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368d309-da0a-41f3-bed1-50a33e0dfc32 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:15.598271 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce548fbb-13a7-4299-9cce-7c7ba8dca95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:15.598937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce548fbb-13a7-4299-9cce-7c7ba8dca95e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:15.599214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce548fbb-13a7-4299-9cce-7c7ba8dca95e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:15.599484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce548fbb-13a7-4299-9cce-7c7ba8dca95e None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:15.600220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce548fbb-13a7-4299-9cce-7c7ba8dca95e None admin] RBAC: Adding query filter params (name=image) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:15.600581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce548fbb-13a7-4299-9cce-7c7ba8dca95e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:15.601983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce548fbb-13a7-4299-9cce-7c7ba8dca95e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:15.607063 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 508/1006] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:15.612479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbae434-bb65-4674-adc3-b919fb9934ce None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:15.706386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbae434-bb65-4674-adc3-b919fb9934ce None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:15.739038 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090512f-caab-4ecb-9f5b-7a9896be4d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:15.739698 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090512f-caab-4ecb-9f5b-7a9896be4d2f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:15.740004 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090512f-caab-4ecb-9f5b-7a9896be4d2f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:15.740278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090512f-caab-4ecb-9f5b-7a9896be4d2f None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:15.740976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090512f-caab-4ecb-9f5b-7a9896be4d2f None admin] RBAC: Adding query filter params (type=image) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:15.741276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090512f-caab-4ecb-9f5b-7a9896be4d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:15.742609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090512f-caab-4ecb-9f5b-7a9896be4d2f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:15.755743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 499/1007] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:17.044180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fcc25-c8af-415e-a2a6-b8186e3cc81d None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:17.044723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fcc25-c8af-415e-a2a6-b8186e3cc81d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:17.044723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fcc25-c8af-415e-a2a6-b8186e3cc81d None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:17.046322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 509/1008] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:17.052194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4020-eedb-4e4f-b6ef-76e342a54648 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:17.052734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4020-eedb-4e4f-b6ef-76e342a54648 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:17.052734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4020-eedb-4e4f-b6ef-76e342a54648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:17.069375 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-7cbb4020-eedb-4e4f-b6ef-76e342a54648 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:17.070542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7cbb4020-eedb-4e4f-b6ef-76e342a54648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:17.136397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 500/1009] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:17 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:17.161395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fcc25-c8af-415e-a2a6-b8186e3cc81d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:17.221798 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43046e-916d-4df7-ae58-a72af3562ae3 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:17.221993 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43046e-916d-4df7-ae58-a72af3562ae3 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:17.222272 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43046e-916d-4df7-ae58-a72af3562ae3 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:17.227866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 501/1010] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:17.229426 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232dcba-da87-4904-a12d-1ea656e1f99e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:17.229784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232dcba-da87-4904-a12d-1ea656e1f99e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:17.230137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232dcba-da87-4904-a12d-1ea656e1f99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:17.246842 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0232dcba-da87-4904-a12d-1ea656e1f99e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:17.248041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0232dcba-da87-4904-a12d-1ea656e1f99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:17.263860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fcc25-c8af-415e-a2a6-b8186e3cc81d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:17.298916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a719132-49ed-4613-b02a-248cc7a821ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:17.300041 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a719132-49ed-4613-b02a-248cc7a821ad None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:17.300532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a719132-49ed-4613-b02a-248cc7a821ad None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:17.301013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a719132-49ed-4613-b02a-248cc7a821ad None admin] PATH_INFO: `/v3/services/compute` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:17.301832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a719132-49ed-4613-b02a-248cc7a821ad None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:17.303326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a719132-49ed-4613-b02a-248cc7a821ad None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:17.312525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 502/1011] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:17 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-3a719132-49ed-4613-b02a-248cc7a821ad None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:17.316447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:17.317504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:17.324505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 510/1012] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:36:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:17.326768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232dcba-da87-4904-a12d-1ea656e1f99e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:17.335828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a719132-49ed-4613-b02a-248cc7a821ad None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:17.435887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232dcba-da87-4904-a12d-1ea656e1f99e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:17.436294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a719132-49ed-4613-b02a-248cc7a821ad None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:17.470050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4516b-676e-4afe-8f6a-b311f1ab90da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:17.470844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4516b-676e-4afe-8f6a-b311f1ab90da None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:17.471120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4516b-676e-4afe-8f6a-b311f1ab90da None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:17.471385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4516b-676e-4afe-8f6a-b311f1ab90da None admin] PATH_INFO: `/v3/domains/default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:17.472641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4516b-676e-4afe-8f6a-b311f1ab90da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:17.473950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34f78-0f84-4d2e-9a45-ff0668f175ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:17.474070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4516b-676e-4afe-8f6a-b311f1ab90da None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:17.474623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34f78-0f84-4d2e-9a45-ff0668f175ae None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:17.474910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34f78-0f84-4d2e-9a45-ff0668f175ae None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:17.475191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34f78-0f84-4d2e-9a45-ff0668f175ae None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:17.475810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 511/1013] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:17.475982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee34f78-0f84-4d2e-9a45-ff0668f175ae None admin] RBAC: Adding query filter params (name=compute) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:17.476247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee34f78-0f84-4d2e-9a45-ff0668f175ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:17.478130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee34f78-0f84-4d2e-9a45-ff0668f175ae None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:17.481201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4516b-676e-4afe-8f6a-b311f1ab90da None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:17.487651 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 503/1014] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:36:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:17.489044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34f78-0f84-4d2e-9a45-ff0668f175ae None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:17.580674 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4516b-676e-4afe-8f6a-b311f1ab90da None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:17.584588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34f78-0f84-4d2e-9a45-ff0668f175ae None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:17.614608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323714f3-70dd-4776-a250-35864c60e3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:17.615862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323714f3-70dd-4776-a250-35864c60e3b9 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:17.616450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323714f3-70dd-4776-a250-35864c60e3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:17.616933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323714f3-70dd-4776-a250-35864c60e3b9 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:17.618170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323714f3-70dd-4776-a250-35864c60e3b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:17.618400 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e516ad7-9783-4841-9f51-acb8125e4362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:17.619055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e516ad7-9783-4841-9f51-acb8125e4362 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:17.619333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e516ad7-9783-4841-9f51-acb8125e4362 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:17.619610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e516ad7-9783-4841-9f51-acb8125e4362 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:17.620355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e516ad7-9783-4841-9f51-acb8125e4362 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:17.620640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323714f3-70dd-4776-a250-35864c60e3b9 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:17.620753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e516ad7-9783-4841-9f51-acb8125e4362 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:17.621988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e516ad7-9783-4841-9f51-acb8125e4362 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:17.626729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 504/1015] 10.222.0.72 () {56 vars in 1112 bytes} [Mon May 16 18:36:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:17.632368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e516ad7-9783-4841-9f51-acb8125e4362 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:17.663736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 512/1016] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:36:17 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:36:17.737474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e516ad7-9783-4841-9f51-acb8125e4362 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:17.774078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ccf5-5fb0-4fd6-a10a-78302fc92578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:17.774913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ccf5-5fb0-4fd6-a10a-78302fc92578 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:17.775202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ccf5-5fb0-4fd6-a10a-78302fc92578 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:17.775482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ccf5-5fb0-4fd6-a10a-78302fc92578 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:17.776275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6ccf5-5fb0-4fd6-a10a-78302fc92578 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:17.777676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6ccf5-5fb0-4fd6-a10a-78302fc92578 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:17.807748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 505/1017] 10.222.0.72 () {60 vars in 1144 bytes} [Mon May 16 18:36:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:36:18.013886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738381b4-bb69-4605-8bc3-95f512f73d41 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:18.014105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738381b4-bb69-4605-8bc3-95f512f73d41 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:18.014358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738381b4-bb69-4605-8bc3-95f512f73d41 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:18.015757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 513/1018] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:18.021236 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d05b-6bb7-47b2-afe9-2c706fad5583 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:18.021529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d05b-6bb7-47b2-afe9-2c706fad5583 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:18.021810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d05b-6bb7-47b2-afe9-2c706fad5583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:18.039218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-9353d05b-6bb7-47b2-afe9-2c706fad5583 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:18.041078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9353d05b-6bb7-47b2-afe9-2c706fad5583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:18.117596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 506/1019] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:18 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:18.141504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738381b4-bb69-4605-8bc3-95f512f73d41 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:18.241084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738381b4-bb69-4605-8bc3-95f512f73d41 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:18.276907 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ef97a-e24a-44a7-93d9-db81b54ecb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:18.277498 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef97a-e24a-44a7-93d9-db81b54ecb0e None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:18.277781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef97a-e24a-44a7-93d9-db81b54ecb0e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:18.278057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef97a-e24a-44a7-93d9-db81b54ecb0e None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:18.278796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ef97a-e24a-44a7-93d9-db81b54ecb0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:18.280311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ef97a-e24a-44a7-93d9-db81b54ecb0e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:18.295825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 514/1020] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:36:18 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:36:19.990867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13996f9-a75d-415a-b786-d98572f4023c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:19.991395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13996f9-a75d-415a-b786-d98572f4023c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:19.991395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13996f9-a75d-415a-b786-d98572f4023c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:19.993243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 507/1021] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:19.998630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9c28-759d-4369-9007-a46a2b18e436 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:19.999073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9c28-759d-4369-9007-a46a2b18e436 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:19.999169 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9c28-759d-4369-9007-a46a2b18e436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.016285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-633b9c28-759d-4369-9007-a46a2b18e436 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:20.017462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-633b9c28-759d-4369-9007-a46a2b18e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:20.088973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 515/1022] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:20.113442 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13996f9-a75d-415a-b786-d98572f4023c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:20.154530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dfb90-63c3-4304-bfaa-8d00f66ae674 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.154861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dfb90-63c3-4304-bfaa-8d00f66ae674 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.155088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dfb90-63c3-4304-bfaa-8d00f66ae674 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.159769 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 516/1023] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:20.161943 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb1c2b-7b6f-4f76-8204-014cc354cf6d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.162428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb1c2b-7b6f-4f76-8204-014cc354cf6d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.162870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb1c2b-7b6f-4f76-8204-014cc354cf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.179562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-71bb1c2b-7b6f-4f76-8204-014cc354cf6d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:20.181698 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-71bb1c2b-7b6f-4f76-8204-014cc354cf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:20.221533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13996f9-a75d-415a-b786-d98572f4023c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:20.248862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 517/1024] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:20.254894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ebe0b-b838-41d0-9b29-3c9c73f5d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:20.255697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ebe0b-b838-41d0-9b29-3c9c73f5d646 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.256012 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ebe0b-b838-41d0-9b29-3c9c73f5d646 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.256291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ebe0b-b838-41d0-9b29-3c9c73f5d646 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.257469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ebe0b-b838-41d0-9b29-3c9c73f5d646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:20.259813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ebe0b-b838-41d0-9b29-3c9c73f5d646 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:20.261600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 508/1025] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:20.266965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb1c2b-7b6f-4f76-8204-014cc354cf6d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:20.273556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ebe0b-b838-41d0-9b29-3c9c73f5d646 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:20.374967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb1c2b-7b6f-4f76-8204-014cc354cf6d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:20.380486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ebe0b-b838-41d0-9b29-3c9c73f5d646 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:20.410930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359a33b-c5a3-4b89-9aee-3abdcbf4a43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:20.411913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359a33b-c5a3-4b89-9aee-3abdcbf4a43f None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.412193 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359a33b-c5a3-4b89-9aee-3abdcbf4a43f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.412464 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359a33b-c5a3-4b89-9aee-3abdcbf4a43f None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.413188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359a33b-c5a3-4b89-9aee-3abdcbf4a43f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:20.415369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359a33b-c5a3-4b89-9aee-3abdcbf4a43f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:20.416254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fec677-f05a-4d6f-b864-cee55909c6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:20.417079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fec677-f05a-4d6f-b864-cee55909c6b6 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.417366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fec677-f05a-4d6f-b864-cee55909c6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.417644 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fec677-f05a-4d6f-b864-cee55909c6b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.428575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fec677-f05a-4d6f-b864-cee55909c6b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:20.436290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 518/1026] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:36:20 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-87fec677-f05a-4d6f-b864-cee55909c6b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:20.441310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:20.442338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:20.443198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:20.447929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 509/1027] 10.222.0.72 () {56 vars in 1120 bytes} [Mon May 16 18:36:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:20.453423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359a33b-c5a3-4b89-9aee-3abdcbf4a43f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:20.540709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e3141-6c24-4163-b855-4e5d79087c34 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.541023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e3141-6c24-4163-b855-4e5d79087c34 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.541212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e3141-6c24-4163-b855-4e5d79087c34 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.542802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 510/1028] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:20.548400 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534769fa-f727-4af0-819f-cb4ed86b0405 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.548686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534769fa-f727-4af0-819f-cb4ed86b0405 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.548955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534769fa-f727-4af0-819f-cb4ed86b0405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.567117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-534769fa-f727-4af0-819f-cb4ed86b0405 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:20.568366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-534769fa-f727-4af0-819f-cb4ed86b0405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:20.570343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359a33b-c5a3-4b89-9aee-3abdcbf4a43f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:20.606363 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292727f-287e-42ba-8a0e-88d6ea373a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:20.607057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292727f-287e-42ba-8a0e-88d6ea373a40 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.607336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292727f-287e-42ba-8a0e-88d6ea373a40 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.607610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292727f-287e-42ba-8a0e-88d6ea373a40 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.608410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292727f-287e-42ba-8a0e-88d6ea373a40 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:20.608721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292727f-287e-42ba-8a0e-88d6ea373a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:20.610120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292727f-287e-42ba-8a0e-88d6ea373a40 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:20.619197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 519/1029] 10.222.0.72 () {56 vars in 1115 bytes} [Mon May 16 18:36:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:20.624581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292727f-287e-42ba-8a0e-88d6ea373a40 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:20.641751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 511/1030] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:20.665608 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534769fa-f727-4af0-819f-cb4ed86b0405 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:20.726579 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292727f-287e-42ba-8a0e-88d6ea373a40 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:20.759857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb2481-dd13-4eb5-9e9d-0d23c218a608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:20.760595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb2481-dd13-4eb5-9e9d-0d23c218a608 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.760910 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb2481-dd13-4eb5-9e9d-0d23c218a608 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.761188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb2481-dd13-4eb5-9e9d-0d23c218a608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.765793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534769fa-f727-4af0-819f-cb4ed86b0405 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:20.771546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb2481-dd13-4eb5-9e9d-0d23c218a608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:20.773347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb2481-dd13-4eb5-9e9d-0d23c218a608 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-76eb2481-dd13-4eb5-9e9d-0d23c218a608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:20.790647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:20.791624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:20.792569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:20.792569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:20.792569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:20.792569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:20.792569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 520/1031] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:20.797489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb2481-dd13-4eb5-9e9d-0d23c218a608 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:20.802352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac115d0-bb33-4862-ba3d-5f9dfe4bfc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:20.803155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac115d0-bb33-4862-ba3d-5f9dfe4bfc54 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.803439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac115d0-bb33-4862-ba3d-5f9dfe4bfc54 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.803745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac115d0-bb33-4862-ba3d-5f9dfe4bfc54 None admin] PATH_INFO: `/v3/services/image` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.804416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac115d0-bb33-4862-ba3d-5f9dfe4bfc54 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:20.805890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac115d0-bb33-4862-ba3d-5f9dfe4bfc54 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-1ac115d0-bb33-4862-ba3d-5f9dfe4bfc54 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:20.817577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:20.818542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:36:20.819387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:20.824156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 512/1032] 10.222.0.72 () {56 vars in 1105 bytes} [Mon May 16 18:36:20 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:20.825333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac115d0-bb33-4862-ba3d-5f9dfe4bfc54 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:20.896743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb2481-dd13-4eb5-9e9d-0d23c218a608 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:20.926839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac115d0-bb33-4862-ba3d-5f9dfe4bfc54 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:20.931424 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5af1d2-b1c7-401a-b245-20778f45a60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:20.932135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5af1d2-b1c7-401a-b245-20778f45a60f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.933237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5af1d2-b1c7-401a-b245-20778f45a60f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.933525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5af1d2-b1c7-401a-b245-20778f45a60f None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.934465 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5af1d2-b1c7-401a-b245-20778f45a60f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:20.934545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5af1d2-b1c7-401a-b245-20778f45a60f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:20.935952 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5af1d2-b1c7-401a-b245-20778f45a60f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:20.948541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 521/1033] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:20.953998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5af1d2-b1c7-401a-b245-20778f45a60f None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:20.964031 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6720b48-2cd9-48bb-9072-4ecd4c8925f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:20.964698 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6720b48-2cd9-48bb-9072-4ecd4c8925f2 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:20.964977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6720b48-2cd9-48bb-9072-4ecd4c8925f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:20.965249 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6720b48-2cd9-48bb-9072-4ecd4c8925f2 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:20.965954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6720b48-2cd9-48bb-9072-4ecd4c8925f2 None admin] RBAC: Adding query filter params (name=image) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:20.966255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6720b48-2cd9-48bb-9072-4ecd4c8925f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:20.967623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6720b48-2cd9-48bb-9072-4ecd4c8925f2 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:20.977799 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 513/1034] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:20.978621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6720b48-2cd9-48bb-9072-4ecd4c8925f2 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:21.052641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5af1d2-b1c7-401a-b245-20778f45a60f None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:21.076481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6720b48-2cd9-48bb-9072-4ecd4c8925f2 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:21.086155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b440b-44d5-4e1e-b6cd-569a4ae6aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:21.087064 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b440b-44d5-4e1e-b6cd-569a4ae6aca2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:21.087346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b440b-44d5-4e1e-b6cd-569a4ae6aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:21.087619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b440b-44d5-4e1e-b6cd-569a4ae6aca2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:21.094957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b440b-44d5-4e1e-b6cd-569a4ae6aca2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:21.096379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b440b-44d5-4e1e-b6cd-569a4ae6aca2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-ba5b440b-44d5-4e1e-b6cd-569a4ae6aca2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:36:21.110722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:21.111739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:21.112696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:21.112696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:21.112696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:36:21.112696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:36:21.112696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:36:21.112696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:36:21.112696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:36:21.112696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:36:21.112696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:36:21.112696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:21.112696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 522/1035] 10.222.0.72 () {56 vars in 1093 bytes} [Mon May 16 18:36:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:21.114471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1aa85-bc2a-4cca-b99f-401c31bc3c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:21.115137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1aa85-bc2a-4cca-b99f-401c31bc3c72 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:21.115417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1aa85-bc2a-4cca-b99f-401c31bc3c72 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:21.115689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1aa85-bc2a-4cca-b99f-401c31bc3c72 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:21.116450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1aa85-bc2a-4cca-b99f-401c31bc3c72 None admin] RBAC: Adding query filter params (type=image) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:21.116755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1aa85-bc2a-4cca-b99f-401c31bc3c72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:21.118375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b440b-44d5-4e1e-b6cd-569a4ae6aca2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:21.118950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1aa85-bc2a-4cca-b99f-401c31bc3c72 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:21.129430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 514/1036] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:21.130264 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1aa85-bc2a-4cca-b99f-401c31bc3c72 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:21.217436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b440b-44d5-4e1e-b6cd-569a4ae6aca2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:21.229138 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1aa85-bc2a-4cca-b99f-401c31bc3c72 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:21.251864 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d7bbd-d58d-4989-a3a0-3b51bfb6f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:21.252541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d7bbd-d58d-4989-a3a0-3b51bfb6f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:21.252821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d7bbd-d58d-4989-a3a0-3b51bfb6f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:21.253094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d7bbd-d58d-4989-a3a0-3b51bfb6f1d6 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:21.253938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d7bbd-d58d-4989-a3a0-3b51bfb6f1d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:21.254247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d7bbd-d58d-4989-a3a0-3b51bfb6f1d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:21.255674 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d7bbd-d58d-4989-a3a0-3b51bfb6f1d6 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:21.262899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bb1f8-1b9a-4e29-bc53-c27279da6262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:21.263568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb1f8-1b9a-4e29-bc53-c27279da6262 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:21.263891 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb1f8-1b9a-4e29-bc53-c27279da6262 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:21.264171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb1f8-1b9a-4e29-bc53-c27279da6262 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:21.264964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bb1f8-1b9a-4e29-bc53-c27279da6262 None admin] RBAC: Adding query filter params (interface=public, service_id=4be127183e8a48cc8157938df7260d17, region_id=RegionOne) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:21.265275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bb1f8-1b9a-4e29-bc53-c27279da6262 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:21.266632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bb1f8-1b9a-4e29-bc53-c27279da6262 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:21.271803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 515/1037] 10.222.0.72 () {56 vars in 1251 bytes} [Mon May 16 18:36:21 2022] GET /identity/v3/endpoints?service_id=4be127183e8a48cc8157938df7260d17&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:21.275095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 523/1038] 10.222.0.72 () {56 vars in 1133 bytes} [Mon May 16 18:36:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:21.277147 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bb1f8-1b9a-4e29-bc53-c27279da6262 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:21.280736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d7bbd-d58d-4989-a3a0-3b51bfb6f1d6 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:21.380038 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d7bbd-d58d-4989-a3a0-3b51bfb6f1d6 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:21.395357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bb1f8-1b9a-4e29-bc53-c27279da6262 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:21.413057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649da87f-fb9a-4496-876f-c123627425ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:21.413708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649da87f-fb9a-4496-876f-c123627425ee None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:21.413980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649da87f-fb9a-4496-876f-c123627425ee None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:21.414254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649da87f-fb9a-4496-876f-c123627425ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:21.427839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd5f95-71c6-431f-a1be-9a65bafef94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:21.428499 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd5f95-71c6-431f-a1be-9a65bafef94c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:21.428782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd5f95-71c6-431f-a1be-9a65bafef94c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:21.429057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd5f95-71c6-431f-a1be-9a65bafef94c None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:21.429734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd5f95-71c6-431f-a1be-9a65bafef94c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:21.431734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd5f95-71c6-431f-a1be-9a65bafef94c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:21.438262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 516/1039] 10.222.0.72 () {56 vars in 1087 bytes} [Mon May 16 18:36:21 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:36:21.485714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649da87f-fb9a-4496-876f-c123627425ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:21.487168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649da87f-fb9a-4496-876f-c123627425ee None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:21.599285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 524/1040] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:36:21.601378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd5f95-71c6-431f-a1be-9a65bafef94c None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:21.709105 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd5f95-71c6-431f-a1be-9a65bafef94c None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:21.741705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ea683-b0e5-46d1-8f54-736703cdda89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:21.743009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ea683-b0e5-46d1-8f54-736703cdda89 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:21.743786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ea683-b0e5-46d1-8f54-736703cdda89 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:21.743786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ea683-b0e5-46d1-8f54-736703cdda89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:21.754119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ea683-b0e5-46d1-8f54-736703cdda89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:21.755593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ea683-b0e5-46d1-8f54-736703cdda89 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-635ea683-b0e5-46d1-8f54-736703cdda89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:21.773019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:21.774610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:21.775525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:21.775525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:21.775525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:21.775525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:21.778921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 517/1041] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:21.780404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649da87f-fb9a-4496-876f-c123627425ee None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:21.876084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649da87f-fb9a-4496-876f-c123627425ee None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:21.908823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84184a-4a30-4f9f-af22-01a6d5be531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:21.909489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84184a-4a30-4f9f-af22-01a6d5be531d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:21.915480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84184a-4a30-4f9f-af22-01a6d5be531d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:21.915480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84184a-4a30-4f9f-af22-01a6d5be531d None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:21.915480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84184a-4a30-4f9f-af22-01a6d5be531d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:21.915480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84184a-4a30-4f9f-af22-01a6d5be531d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:21.915480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84184a-4a30-4f9f-af22-01a6d5be531d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:21.930901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 525/1042] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:21.933697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ea683-b0e5-46d1-8f54-736703cdda89 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:22.031295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ea683-b0e5-46d1-8f54-736703cdda89 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:22.063599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448e039-9aa7-43fb-865a-2d45c834d01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:22.064422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448e039-9aa7-43fb-865a-2d45c834d01b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:22.064704 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448e039-9aa7-43fb-865a-2d45c834d01b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:22.064977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448e039-9aa7-43fb-865a-2d45c834d01b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:22.072047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448e039-9aa7-43fb-865a-2d45c834d01b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:22.073473 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448e039-9aa7-43fb-865a-2d45c834d01b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-7448e039-9aa7-43fb-865a-2d45c834d01b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:36:22.087903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:22.094374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:22.095492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:36:22.095492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:36:22.095492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:36:22.095492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:36:22.095492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:36:22.095492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:36:22.095492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:22.095492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:22.095492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 518/1043] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:22.097310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84184a-4a30-4f9f-af22-01a6d5be531d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:22.194971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84184a-4a30-4f9f-af22-01a6d5be531d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:22.228183 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cc745-4c0b-4009-b590-1460e7375098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:22.228844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cc745-4c0b-4009-b590-1460e7375098 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:22.229124 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cc745-4c0b-4009-b590-1460e7375098 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:22.229395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cc745-4c0b-4009-b590-1460e7375098 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:22.230184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cc745-4c0b-4009-b590-1460e7375098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:22.230497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cc745-4c0b-4009-b590-1460e7375098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:22.231937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cc745-4c0b-4009-b590-1460e7375098 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:22.249497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 526/1044] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:22.250697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448e039-9aa7-43fb-865a-2d45c834d01b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:22.347059 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448e039-9aa7-43fb-865a-2d45c834d01b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:22.379836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d62270-dea9-414e-a0d4-da868efd3e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:22.380495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d62270-dea9-414e-a0d4-da868efd3e73 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:22.380777 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d62270-dea9-414e-a0d4-da868efd3e73 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:22.381051 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d62270-dea9-414e-a0d4-da868efd3e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:22.381881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d62270-dea9-414e-a0d4-da868efd3e73 None admin] RBAC: Adding query filter params (role.id=be018b67ef8944b2959b4c5d0451f8cc, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=cc09bfcc0d8c4d20a156b3b08ffafa34) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:22.382192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d62270-dea9-414e-a0d4-da868efd3e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:22.383653 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d62270-dea9-414e-a0d4-da868efd3e73 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:22.395989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 519/1045] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:36:22 2022] GET /identity/v3/role_assignments?user.id=cc09bfcc0d8c4d20a156b3b08ffafa34&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=be018b67ef8944b2959b4c5d0451f8cc => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:22.777066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118fc0-9129-4a62-a5d8-ea3bda7704f2 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:22.777462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118fc0-9129-4a62-a5d8-ea3bda7704f2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:22.777639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118fc0-9129-4a62-a5d8-ea3bda7704f2 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:22.779145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 527/1046] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:22.784332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3053af-e431-491e-b75e-214d3da78ed7 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:22.784630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3053af-e431-491e-b75e-214d3da78ed7 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:22.784915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3053af-e431-491e-b75e-214d3da78ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:22.802013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-ff3053af-e431-491e-b75e-214d3da78ed7 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:22.803290 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ff3053af-e431-491e-b75e-214d3da78ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:22.868648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 520/1047] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:22.891995 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118fc0-9129-4a62-a5d8-ea3bda7704f2 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:23.000312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118fc0-9129-4a62-a5d8-ea3bda7704f2 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:23.032745 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c372d55-403f-410a-996e-1668901c3b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:23.033466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372d55-403f-410a-996e-1668901c3b7c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:23.033747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372d55-403f-410a-996e-1668901c3b7c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:23.034021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372d55-403f-410a-996e-1668901c3b7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:23.044594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c372d55-403f-410a-996e-1668901c3b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-5c372d55-403f-410a-996e-1668901c3b7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:23.052222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:23.053153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:23.054016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:23.056033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 528/1048] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:36:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:23.059439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3053af-e431-491e-b75e-214d3da78ed7 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:23.154254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3053af-e431-491e-b75e-214d3da78ed7 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:23.187051 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37f719-901d-4de1-88bf-2bb922a64510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:23.189635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f719-901d-4de1-88bf-2bb922a64510 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:23.189764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f719-901d-4de1-88bf-2bb922a64510 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:23.189990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f719-901d-4de1-88bf-2bb922a64510 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:23.190738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37f719-901d-4de1-88bf-2bb922a64510 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:23.191041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37f719-901d-4de1-88bf-2bb922a64510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:23.192421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37f719-901d-4de1-88bf-2bb922a64510 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:23.206009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 521/1049] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:36:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:23.207361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c372d55-403f-410a-996e-1668901c3b7c None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:23.305631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c372d55-403f-410a-996e-1668901c3b7c None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:23.338586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f365eb0-3e3b-4ec5-9fb8-4f7a54e35193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:23.339625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f365eb0-3e3b-4ec5-9fb8-4f7a54e35193 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:23.340036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f365eb0-3e3b-4ec5-9fb8-4f7a54e35193 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:23.340410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f365eb0-3e3b-4ec5-9fb8-4f7a54e35193 None admin] PATH_INFO: `/v3/users/bc780bf18fcf42f289b77aa88fea9412` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:23.354429 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f365eb0-3e3b-4ec5-9fb8-4f7a54e35193 None admin] RBAC: Authorizing `identity:get_user(user_id=bc780bf18fcf42f289b77aa88fea9412)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:23.356055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f365eb0-3e3b-4ec5-9fb8-4f7a54e35193 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:23.362436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 529/1050] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:23 2022] GET /identity/v3/users/bc780bf18fcf42f289b77aa88fea9412 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:23.363626 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37f719-901d-4de1-88bf-2bb922a64510 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:23.478422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37f719-901d-4de1-88bf-2bb922a64510 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:23.515027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1b8e8-87c2-4384-9db2-f2e049f8cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:23.515763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1b8e8-87c2-4384-9db2-f2e049f8cb43 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:23.516027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1b8e8-87c2-4384-9db2-f2e049f8cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:23.516310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1b8e8-87c2-4384-9db2-f2e049f8cb43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:23.587188 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1b8e8-87c2-4384-9db2-f2e049f8cb43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:23.588767 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1b8e8-87c2-4384-9db2-f2e049f8cb43 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:23.682247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 522/1051] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:36:23.687806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f365eb0-3e3b-4ec5-9fb8-4f7a54e35193 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:23.704879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6df5d-81ae-444a-9ca3-b34bf7f98792 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:23.705379 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6df5d-81ae-444a-9ca3-b34bf7f98792 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:23.705662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6df5d-81ae-444a-9ca3-b34bf7f98792 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:23.707152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 523/1052] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:23.712587 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814504d8-f529-4144-b6b7-98cfbcdbb16c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:23.712873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814504d8-f529-4144-b6b7-98cfbcdbb16c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:23.713149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814504d8-f529-4144-b6b7-98cfbcdbb16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:23.729239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-814504d8-f529-4144-b6b7-98cfbcdbb16c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:23.730407 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-814504d8-f529-4144-b6b7-98cfbcdbb16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:23.791449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f365eb0-3e3b-4ec5-9fb8-4f7a54e35193 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:23.799380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 524/1053] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:23.824537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814504d8-f529-4144-b6b7-98cfbcdbb16c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:23.827049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41db10-c88f-4c5b-aa22-86fb9bb136e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:23.828196 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41db10-c88f-4c5b-aa22-86fb9bb136e0 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:23.828417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41db10-c88f-4c5b-aa22-86fb9bb136e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:23.828782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41db10-c88f-4c5b-aa22-86fb9bb136e0 None admin] PATH_INFO: `/v3/projects/7f1718a49834488daec340d8a7abe921` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:23.830057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41db10-c88f-4c5b-aa22-86fb9bb136e0 None admin] RBAC: Authorizing `identity:get_project(project_id=7f1718a49834488daec340d8a7abe921)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:23.831562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41db10-c88f-4c5b-aa22-86fb9bb136e0 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:23.833529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 530/1054] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:36:23 2022] GET /identity/v3/projects/7f1718a49834488daec340d8a7abe921 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:23.839741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41db10-c88f-4c5b-aa22-86fb9bb136e0 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:23.927456 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814504d8-f529-4144-b6b7-98cfbcdbb16c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:23.938315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41db10-c88f-4c5b-aa22-86fb9bb136e0 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:23.962821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ad709-29dd-4cac-9668-580d339d98f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:23.963743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ad709-29dd-4cac-9668-580d339d98f9 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:23.964096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ad709-29dd-4cac-9668-580d339d98f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:23.964446 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ad709-29dd-4cac-9668-580d339d98f9 None admin] PATH_INFO: `/v3/services/image` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:23.965107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ad709-29dd-4cac-9668-580d339d98f9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:23.966470 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ad709-29dd-4cac-9668-580d339d98f9 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:23.972416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dda76-4a21-435b-aced-58657e2999cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:23.973128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dda76-4a21-435b-aced-58657e2999cb None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:23.973470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dda76-4a21-435b-aced-58657e2999cb None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:23.973805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dda76-4a21-435b-aced-58657e2999cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:23.974696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dda76-4a21-435b-aced-58657e2999cb None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=7f1718a49834488daec340d8a7abe921, user.id=bc780bf18fcf42f289b77aa88fea9412) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:23.975076 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dda76-4a21-435b-aced-58657e2999cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:23.976565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dda76-4a21-435b-aced-58657e2999cb None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-d31ad709-29dd-4cac-9668-580d339d98f9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:23.978113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:23.979295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:23.980371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 525/1055] 10.222.0.72 () {56 vars in 1105 bytes} [Mon May 16 18:36:23 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:23.996035 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 531/1056] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:36:23 2022] GET /identity/v3/role_assignments?user.id=bc780bf18fcf42f289b77aa88fea9412&scope.project.id=7f1718a49834488daec340d8a7abe921&role.id=b104fd2e772843a0974990f965d8b589 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:23.996317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ad709-29dd-4cac-9668-580d339d98f9 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:24.089469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ad709-29dd-4cac-9668-580d339d98f9 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:24.125574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b2448-f992-42a5-a7a5-2a81bfe7c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:24.126255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2448-f992-42a5-a7a5-2a81bfe7c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:24.126536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2448-f992-42a5-a7a5-2a81bfe7c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:24.126808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2448-f992-42a5-a7a5-2a81bfe7c1f0 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:24.127530 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b2448-f992-42a5-a7a5-2a81bfe7c1f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:24.127869 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b2448-f992-42a5-a7a5-2a81bfe7c1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:24.129275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b2448-f992-42a5-a7a5-2a81bfe7c1f0 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:24.141563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 526/1057] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:24.141784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dda76-4a21-435b-aced-58657e2999cb None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:24.242071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dda76-4a21-435b-aced-58657e2999cb None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:24.275925 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bcd8e-a0cf-4628-a7ee-18eb42d6ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:24.276594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bcd8e-a0cf-4628-a7ee-18eb42d6ac4f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:24.276871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bcd8e-a0cf-4628-a7ee-18eb42d6ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:24.277136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bcd8e-a0cf-4628-a7ee-18eb42d6ac4f None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:24.277843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bcd8e-a0cf-4628-a7ee-18eb42d6ac4f None admin] RBAC: Adding query filter params (type=image) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:24.278145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bcd8e-a0cf-4628-a7ee-18eb42d6ac4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:24.279489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bcd8e-a0cf-4628-a7ee-18eb42d6ac4f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:24.291239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 532/1058] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:24.291426 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b2448-f992-42a5-a7a5-2a81bfe7c1f0 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:24.388630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b2448-f992-42a5-a7a5-2a81bfe7c1f0 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:24.420801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4102c16-0b05-4b00-9920-4da1fc6989f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:24.421456 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4102c16-0b05-4b00-9920-4da1fc6989f0 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:24.421735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4102c16-0b05-4b00-9920-4da1fc6989f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:24.422007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4102c16-0b05-4b00-9920-4da1fc6989f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:24.422739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4102c16-0b05-4b00-9920-4da1fc6989f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:24.424113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4102c16-0b05-4b00-9920-4da1fc6989f0 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:24.451750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 527/1059] 10.222.0.72 () {60 vars in 1144 bytes} [Mon May 16 18:36:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:36:24.647438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f78d0-8750-44fa-84f0-0f477325a441 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:24.647651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f78d0-8750-44fa-84f0-0f477325a441 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:24.647972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f78d0-8750-44fa-84f0-0f477325a441 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:24.650062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 533/1060] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:24.655658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9749bb6-c8da-4450-874c-0ef9a54ef546 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:24.655991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9749bb6-c8da-4450-874c-0ef9a54ef546 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:24.656279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9749bb6-c8da-4450-874c-0ef9a54ef546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:24.674051 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-a9749bb6-c8da-4450-874c-0ef9a54ef546 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:24.675233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a9749bb6-c8da-4450-874c-0ef9a54ef546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:24.746361 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 528/1061] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:24.769292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f78d0-8750-44fa-84f0-0f477325a441 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:24.871853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f78d0-8750-44fa-84f0-0f477325a441 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:24.905285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaa74e-1f4d-4e16-b504-3a8783e7d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:24.906032 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaa74e-1f4d-4e16-b504-3a8783e7d91b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:24.906315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaa74e-1f4d-4e16-b504-3a8783e7d91b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:24.906588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaa74e-1f4d-4e16-b504-3a8783e7d91b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:24.921805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcaa74e-1f4d-4e16-b504-3a8783e7d91b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-7bcaa74e-1f4d-4e16-b504-3a8783e7d91b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:24.936420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:24.937407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:24.938250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 534/1062] 10.222.0.72 () {56 vars in 1120 bytes} [Mon May 16 18:36:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:24.938944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9749bb6-c8da-4450-874c-0ef9a54ef546 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:25.031940 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9749bb6-c8da-4450-874c-0ef9a54ef546 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:25.064635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bd255-03d4-4266-9b58-4263cd7dea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:25.065304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bd255-03d4-4266-9b58-4263cd7dea85 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:25.065582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bd255-03d4-4266-9b58-4263cd7dea85 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:25.065854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bd255-03d4-4266-9b58-4263cd7dea85 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:25.066597 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bd255-03d4-4266-9b58-4263cd7dea85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:25.066899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bd255-03d4-4266-9b58-4263cd7dea85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:25.068286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bd255-03d4-4266-9b58-4263cd7dea85 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:25.081151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 529/1063] 10.222.0.72 () {56 vars in 1115 bytes} [Mon May 16 18:36:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:25.082358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaa74e-1f4d-4e16-b504-3a8783e7d91b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:25.187078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaa74e-1f4d-4e16-b504-3a8783e7d91b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:25.222880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77faedf-b3c2-4fbd-8820-4f0fcea5af47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:25.224029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77faedf-b3c2-4fbd-8820-4f0fcea5af47 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:25.224517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77faedf-b3c2-4fbd-8820-4f0fcea5af47 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:25.224988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77faedf-b3c2-4fbd-8820-4f0fcea5af47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:25.235727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77faedf-b3c2-4fbd-8820-4f0fcea5af47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:25.237501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77faedf-b3c2-4fbd-8820-4f0fcea5af47 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-e77faedf-b3c2-4fbd-8820-4f0fcea5af47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:25.254204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:25.255549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:25.256476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:25.256476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:25.256476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:25.256476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:25.262392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 535/1064] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:25.263649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bd255-03d4-4266-9b58-4263cd7dea85 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:25.360184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bd255-03d4-4266-9b58-4263cd7dea85 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:25.392050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf95ab-a36d-4046-86a4-51b644093528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:25.392892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf95ab-a36d-4046-86a4-51b644093528 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:25.393320 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf95ab-a36d-4046-86a4-51b644093528 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:25.393769 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf95ab-a36d-4046-86a4-51b644093528 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:25.394657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf95ab-a36d-4046-86a4-51b644093528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:25.395103 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf95ab-a36d-4046-86a4-51b644093528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:25.396627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf95ab-a36d-4046-86a4-51b644093528 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:25.408371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 530/1065] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:25.413574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77faedf-b3c2-4fbd-8820-4f0fcea5af47 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:25.523092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77faedf-b3c2-4fbd-8820-4f0fcea5af47 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:25.560554 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2779a-96e9-4e5e-b0bb-b9d11599fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:25.561350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2779a-96e9-4e5e-b0bb-b9d11599fc85 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:25.561628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2779a-96e9-4e5e-b0bb-b9d11599fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:25.561900 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2779a-96e9-4e5e-b0bb-b9d11599fc85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:25.569539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2779a-96e9-4e5e-b0bb-b9d11599fc85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:25.571622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2779a-96e9-4e5e-b0bb-b9d11599fc85 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-16b2779a-96e9-4e5e-b0bb-b9d11599fc85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:36:25.585535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:25.586731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:25.588132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:25.588132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:25.588132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:36:25.588132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:36:25.588132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:36:25.588132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:36:25.588132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:36:25.588132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:36:25.588132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:36:25.588132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:25.588984 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 536/1066] 10.222.0.72 () {56 vars in 1093 bytes} [Mon May 16 18:36:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:25.592483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf95ab-a36d-4046-86a4-51b644093528 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:25.691213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf95ab-a36d-4046-86a4-51b644093528 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:25.724437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9ac96-3a98-4d29-94c4-c7668dc18452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:25.725111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9ac96-3a98-4d29-94c4-c7668dc18452 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:25.725397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9ac96-3a98-4d29-94c4-c7668dc18452 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:25.725676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9ac96-3a98-4d29-94c4-c7668dc18452 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:25.726525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9ac96-3a98-4d29-94c4-c7668dc18452 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:25.726973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9ac96-3a98-4d29-94c4-c7668dc18452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:25.728466 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9ac96-3a98-4d29-94c4-c7668dc18452 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:25.750536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 531/1067] 10.222.0.72 () {56 vars in 1133 bytes} [Mon May 16 18:36:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:25.751771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2779a-96e9-4e5e-b0bb-b9d11599fc85 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:25.847607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2779a-96e9-4e5e-b0bb-b9d11599fc85 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:25.884541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f8a9d-84df-4b50-8c6d-e169aecaef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:25.885332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f8a9d-84df-4b50-8c6d-e169aecaef39 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:25.885614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f8a9d-84df-4b50-8c6d-e169aecaef39 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:25.885887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f8a9d-84df-4b50-8c6d-e169aecaef39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:25.896050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f8a9d-84df-4b50-8c6d-e169aecaef39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:25.897483 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f8a9d-84df-4b50-8c6d-e169aecaef39 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-657f8a9d-84df-4b50-8c6d-e169aecaef39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:25.915625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:25.916594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:25.917502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:25.917502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:25.917502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:25.917502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:25.917502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 537/1068] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:25.923453 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9ac96-3a98-4d29-94c4-c7668dc18452 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:26.021472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9ac96-3a98-4d29-94c4-c7668dc18452 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:26.060170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4f241-664e-4d94-8aeb-bd0e999d0a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:26.060862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4f241-664e-4d94-8aeb-bd0e999d0a71 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.061147 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4f241-664e-4d94-8aeb-bd0e999d0a71 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.061427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4f241-664e-4d94-8aeb-bd0e999d0a71 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.062168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4f241-664e-4d94-8aeb-bd0e999d0a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:26.062475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4f241-664e-4d94-8aeb-bd0e999d0a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:26.063898 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4f241-664e-4d94-8aeb-bd0e999d0a71 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:26.080812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 532/1069] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:26.082044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f8a9d-84df-4b50-8c6d-e169aecaef39 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:26.178515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f8a9d-84df-4b50-8c6d-e169aecaef39 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:26.211550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f9516-bb3c-4270-a04a-5a73b2e4cd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:26.212396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9516-bb3c-4270-a04a-5a73b2e4cd09 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.212681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9516-bb3c-4270-a04a-5a73b2e4cd09 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.212955 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9516-bb3c-4270-a04a-5a73b2e4cd09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.219942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f9516-bb3c-4270-a04a-5a73b2e4cd09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:26.221385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f9516-bb3c-4270-a04a-5a73b2e4cd09 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:26.224892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7ed68-7aac-4562-9fa0-9e858d2ff989 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.225290 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7ed68-7aac-4562-9fa0-9e858d2ff989 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.225577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7ed68-7aac-4562-9fa0-9e858d2ff989 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.227702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 533/1070] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:26.232436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbea78-a711-4291-a212-f0e4488c8d33 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.232729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbea78-a711-4291-a212-f0e4488c8d33 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.233011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbea78-a711-4291-a212-f0e4488c8d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-880f9516-bb3c-4270-a04a-5a73b2e4cd09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:36:26.236458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:26.237313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:26.243983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:36:26.243983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:36:26.243983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:36:26.243983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:36:26.243983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:36:26.243983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:36:26.243983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:26.243983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:26.243983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 538/1071] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:26.244469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f9516-bb3c-4270-a04a-5a73b2e4cd09 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:26.250553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-8ccbea78-a711-4291-a212-f0e4488c8d33 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:26.251757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-8ccbea78-a711-4291-a212-f0e4488c8d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:26.318391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 534/1072] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:26.341948 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbea78-a711-4291-a212-f0e4488c8d33 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:26.343272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f9516-bb3c-4270-a04a-5a73b2e4cd09 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:26.376832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13c203-ac33-40d9-9c4a-a3577e5d8dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:26.377496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13c203-ac33-40d9-9c4a-a3577e5d8dfb None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.377776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13c203-ac33-40d9-9c4a-a3577e5d8dfb None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.378049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13c203-ac33-40d9-9c4a-a3577e5d8dfb None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.378836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13c203-ac33-40d9-9c4a-a3577e5d8dfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:26.379141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13c203-ac33-40d9-9c4a-a3577e5d8dfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:26.380591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13c203-ac33-40d9-9c4a-a3577e5d8dfb None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:26.392958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 539/1073] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:26.399236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13c203-ac33-40d9-9c4a-a3577e5d8dfb None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:26.445568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbea78-a711-4291-a212-f0e4488c8d33 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:26.479024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79a356-0ae0-49e6-9949-5c468f45b44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:26.479865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79a356-0ae0-49e6-9949-5c468f45b44d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.480155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79a356-0ae0-49e6-9949-5c468f45b44d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.480439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79a356-0ae0-49e6-9949-5c468f45b44d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.490265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79a356-0ae0-49e6-9949-5c468f45b44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:26.498445 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13c203-ac33-40d9-9c4a-a3577e5d8dfb None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-ba79a356-0ae0-49e6-9949-5c468f45b44d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:26.498581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:26.499476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:26.500365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 535/1074] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:36:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:26.505779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79a356-0ae0-49e6-9949-5c468f45b44d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:26.538254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062eca0-dfdf-44f3-a69d-82f69b654e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:26.539168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062eca0-dfdf-44f3-a69d-82f69b654e69 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.540071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062eca0-dfdf-44f3-a69d-82f69b654e69 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.540350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062eca0-dfdf-44f3-a69d-82f69b654e69 None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/cc09bfcc0d8c4d20a156b3b08ffafa34/roles/be018b67ef8944b2959b4c5d0451f8cc` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.542766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062eca0-dfdf-44f3-a69d-82f69b654e69 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=cc09bfcc0d8c4d20a156b3b08ffafa34, role_id=be018b67ef8944b2959b4c5d0451f8cc)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:26.544284 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062eca0-dfdf-44f3-a69d-82f69b654e69 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:26.560241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 540/1075] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:36:26 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/cc09bfcc0d8c4d20a156b3b08ffafa34/roles/be018b67ef8944b2959b4c5d0451f8cc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:36:26.614994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79a356-0ae0-49e6-9949-5c468f45b44d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:26.653631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2eb066-777b-4127-8a65-9ad4cb471503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:26.654332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eb066-777b-4127-8a65-9ad4cb471503 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.654610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eb066-777b-4127-8a65-9ad4cb471503 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.654886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eb066-777b-4127-8a65-9ad4cb471503 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.655660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eb066-777b-4127-8a65-9ad4cb471503 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:26.656001 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eb066-777b-4127-8a65-9ad4cb471503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:26.657398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eb066-777b-4127-8a65-9ad4cb471503 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:26.671738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 536/1076] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:36:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:26.673493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062eca0-dfdf-44f3-a69d-82f69b654e69 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:26.728153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22863638-2b67-42e9-a3fb-506a1eb9efc5 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.728427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22863638-2b67-42e9-a3fb-506a1eb9efc5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.728669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22863638-2b67-42e9-a3fb-506a1eb9efc5 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.730201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 537/1077] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:26.735589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d621-85b4-43fe-84a2-9a2a372dc5fb None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.735918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d621-85b4-43fe-84a2-9a2a372dc5fb None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.736199 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d621-85b4-43fe-84a2-9a2a372dc5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.758913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-2da0d621-85b4-43fe-84a2-9a2a372dc5fb None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:26.760141 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2da0d621-85b4-43fe-84a2-9a2a372dc5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:26.786949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062eca0-dfdf-44f3-a69d-82f69b654e69 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:26.821520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980baac3-6bd0-4e7b-8711-fce3984eb106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:26.822572 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980baac3-6bd0-4e7b-8711-fce3984eb106 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.822857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980baac3-6bd0-4e7b-8711-fce3984eb106 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.823130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980baac3-6bd0-4e7b-8711-fce3984eb106 None admin] PATH_INFO: `/v3/users/bc780bf18fcf42f289b77aa88fea9412` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.824344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980baac3-6bd0-4e7b-8711-fce3984eb106 None admin] RBAC: Authorizing `identity:get_user(user_id=bc780bf18fcf42f289b77aa88fea9412)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:26.825772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980baac3-6bd0-4e7b-8711-fce3984eb106 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:26.831912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 541/1078] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:26 2022] GET /identity/v3/users/bc780bf18fcf42f289b77aa88fea9412 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:26.832075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 538/1079] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:26.832878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980baac3-6bd0-4e7b-8711-fce3984eb106 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:26.848398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0d621-85b4-43fe-84a2-9a2a372dc5fb None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:26.933108 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980baac3-6bd0-4e7b-8711-fce3984eb106 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:26.955035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0d621-85b4-43fe-84a2-9a2a372dc5fb None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:26.972352 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac51a0a-363b-49fc-a1c4-9f9b4e478ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:26.973211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51a0a-363b-49fc-a1c4-9f9b4e478ff4 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.973485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51a0a-363b-49fc-a1c4-9f9b4e478ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.973757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51a0a-363b-49fc-a1c4-9f9b4e478ff4 None admin] PATH_INFO: `/v3/projects/7f1718a49834488daec340d8a7abe921` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:26.974914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac51a0a-363b-49fc-a1c4-9f9b4e478ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=7f1718a49834488daec340d8a7abe921)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:26.976373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac51a0a-363b-49fc-a1c4-9f9b4e478ff4 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:26.978084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 542/1080] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:36:26 2022] GET /identity/v3/projects/7f1718a49834488daec340d8a7abe921 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:26.983749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac51a0a-363b-49fc-a1c4-9f9b4e478ff4 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:26.989282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a57d4d-2893-4656-9003-7410a06ed10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:26.989939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a57d4d-2893-4656-9003-7410a06ed10f None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:26.990224 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a57d4d-2893-4656-9003-7410a06ed10f None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:26.990501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a57d4d-2893-4656-9003-7410a06ed10f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:27.061760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a57d4d-2893-4656-9003-7410a06ed10f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:27.063490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a57d4d-2893-4656-9003-7410a06ed10f None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:27.082588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac51a0a-363b-49fc-a1c4-9f9b4e478ff4 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:27.118420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c534c87-9fc3-4169-b871-da1a0bf00005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:27.119306 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c534c87-9fc3-4169-b871-da1a0bf00005 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:27.119587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c534c87-9fc3-4169-b871-da1a0bf00005 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:27.119891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c534c87-9fc3-4169-b871-da1a0bf00005 None admin] PATH_INFO: `/v3/projects/7f1718a49834488daec340d8a7abe921/users/bc780bf18fcf42f289b77aa88fea9412/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:27.121942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c534c87-9fc3-4169-b871-da1a0bf00005 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f1718a49834488daec340d8a7abe921, user_id=bc780bf18fcf42f289b77aa88fea9412, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:27.123356 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c534c87-9fc3-4169-b871-da1a0bf00005 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:27.143950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 543/1081] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:36:26 2022] PUT /identity/v3/projects/7f1718a49834488daec340d8a7abe921/users/bc780bf18fcf42f289b77aa88fea9412/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:36:27.163743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 539/1082] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:36:27.171044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c534c87-9fc3-4169-b871-da1a0bf00005 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:27.277984 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c534c87-9fc3-4169-b871-da1a0bf00005 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:27.315502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5a1af-defa-4ddb-a55a-2d5c260d3999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:27.316362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5a1af-defa-4ddb-a55a-2d5c260d3999 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:27.316634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5a1af-defa-4ddb-a55a-2d5c260d3999 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:27.316903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5a1af-defa-4ddb-a55a-2d5c260d3999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:27.331117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5a1af-defa-4ddb-a55a-2d5c260d3999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:27.332582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5a1af-defa-4ddb-a55a-2d5c260d3999 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-c1a5a1af-defa-4ddb-a55a-2d5c260d3999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:27.351018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:27.352855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:27.353830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:27.353830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:27.353830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:27.353830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:27.354235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 544/1083] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:27.359830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a57d4d-2893-4656-9003-7410a06ed10f None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:27.457211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a57d4d-2893-4656-9003-7410a06ed10f None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:27.490793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547a436-d9c5-4a3b-8939-0e86fc653378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:27.491463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547a436-d9c5-4a3b-8939-0e86fc653378 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:27.491775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547a436-d9c5-4a3b-8939-0e86fc653378 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:27.492060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547a436-d9c5-4a3b-8939-0e86fc653378 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:27.493448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547a436-d9c5-4a3b-8939-0e86fc653378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:27.493760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547a436-d9c5-4a3b-8939-0e86fc653378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:27.495135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547a436-d9c5-4a3b-8939-0e86fc653378 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:27.506367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 540/1084] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:28.868475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e17f-a40d-4bbd-a9e7-9d856f9cfb0e None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:28.869044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e17f-a40d-4bbd-a9e7-9d856f9cfb0e None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:28.869044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e17f-a40d-4bbd-a9e7-9d856f9cfb0e None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:28.870378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 545/1085] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:28.875971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaaebe-ae4b-4634-8a8f-65b02d73c8f1 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:28.876414 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaaebe-ae4b-4634-8a8f-65b02d73c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:28.876675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaaebe-ae4b-4634-8a8f-65b02d73c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:28.893660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f3eaaebe-ae4b-4634-8a8f-65b02d73c8f1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:28.894840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f3eaaebe-ae4b-4634-8a8f-65b02d73c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:28.968330 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 541/1086] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:28.992047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e17f-a40d-4bbd-a9e7-9d856f9cfb0e None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:29.096044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e17f-a40d-4bbd-a9e7-9d856f9cfb0e None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:29.129880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e58863-6f68-44e9-9621-09507cd70568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:29.130619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e58863-6f68-44e9-9621-09507cd70568 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:29.130895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e58863-6f68-44e9-9621-09507cd70568 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:29.131167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e58863-6f68-44e9-9621-09507cd70568 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:29.141849 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e58863-6f68-44e9-9621-09507cd70568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-b3e58863-6f68-44e9-9621-09507cd70568 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:29.150960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:29.151953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:29.152816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 546/1087] 10.222.0.72 () {56 vars in 1120 bytes} [Mon May 16 18:36:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:29.158264 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaaebe-ae4b-4634-8a8f-65b02d73c8f1 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:29.259125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaaebe-ae4b-4634-8a8f-65b02d73c8f1 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:29.291937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fe29d-9239-4e58-a76b-bd17286d7888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:29.292600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe29d-9239-4e58-a76b-bd17286d7888 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:29.292883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe29d-9239-4e58-a76b-bd17286d7888 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:29.293162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe29d-9239-4e58-a76b-bd17286d7888 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:29.293908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fe29d-9239-4e58-a76b-bd17286d7888 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:29.294213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fe29d-9239-4e58-a76b-bd17286d7888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:29.295579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fe29d-9239-4e58-a76b-bd17286d7888 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:29.303828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 542/1088] 10.222.0.72 () {56 vars in 1115 bytes} [Mon May 16 18:36:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:29.309562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e58863-6f68-44e9-9621-09507cd70568 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:29.392826 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12292110-2264-47a6-b525-42f8f1971f46 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:29.393104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12292110-2264-47a6-b525-42f8f1971f46 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:29.393318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12292110-2264-47a6-b525-42f8f1971f46 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:29.394666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 543/1089] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:36:29.400157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbee20-6a5b-4742-aa39-5d3325a4d05e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:29.400443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbee20-6a5b-4742-aa39-5d3325a4d05e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:29.400718 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbee20-6a5b-4742-aa39-5d3325a4d05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:29.405890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e58863-6f68-44e9-9621-09507cd70568 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:29.417386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-52cbee20-6a5b-4742-aa39-5d3325a4d05e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:29.418573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-52cbee20-6a5b-4742-aa39-5d3325a4d05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:29.438265 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ab921-4e64-47b6-a9d7-857d1a3d9c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:29.439057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ab921-4e64-47b6-a9d7-857d1a3d9c6a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:29.439337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ab921-4e64-47b6-a9d7-857d1a3d9c6a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:29.439609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ab921-4e64-47b6-a9d7-857d1a3d9c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:29.449673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ab921-4e64-47b6-a9d7-857d1a3d9c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:29.451109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ab921-4e64-47b6-a9d7-857d1a3d9c6a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-a27ab921-4e64-47b6-a9d7-857d1a3d9c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:29.468171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:29.469244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:29.470219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:29.470219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:29.470219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:29.470219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:29.472040 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 547/1090] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:29.474917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ab921-4e64-47b6-a9d7-857d1a3d9c6a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:29.483323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 544/1091] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:36:29.506770 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbee20-6a5b-4742-aa39-5d3325a4d05e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:29.567852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ab921-4e64-47b6-a9d7-857d1a3d9c6a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:29.599870 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbee20-6a5b-4742-aa39-5d3325a4d05e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:29.600698 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429392be-8258-47d0-987f-1ba2876cab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:29.601350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429392be-8258-47d0-987f-1ba2876cab21 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:29.601661 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429392be-8258-47d0-987f-1ba2876cab21 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:29.602022 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429392be-8258-47d0-987f-1ba2876cab21 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:29.602735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429392be-8258-47d0-987f-1ba2876cab21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:29.603037 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429392be-8258-47d0-987f-1ba2876cab21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:29.604413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429392be-8258-47d0-987f-1ba2876cab21 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:29.615573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 548/1092] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:29.621369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429392be-8258-47d0-987f-1ba2876cab21 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:29.632170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4411a6d-9112-4c61-9b89-79750c2670b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:29.633539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4411a6d-9112-4c61-9b89-79750c2670b6 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:29.633817 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4411a6d-9112-4c61-9b89-79750c2670b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:29.634087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4411a6d-9112-4c61-9b89-79750c2670b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:29.643845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4411a6d-9112-4c61-9b89-79750c2670b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-c4411a6d-9112-4c61-9b89-79750c2670b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:29.651980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:29.653096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:29.653976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 545/1093] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:29.658971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4411a6d-9112-4c61-9b89-79750c2670b6 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:29.716318 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429392be-8258-47d0-987f-1ba2876cab21 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:29.748282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc966c2-8ef5-482c-b265-9969c8543084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:29.749062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc966c2-8ef5-482c-b265-9969c8543084 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:29.749340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc966c2-8ef5-482c-b265-9969c8543084 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:29.749607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc966c2-8ef5-482c-b265-9969c8543084 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:29.751895 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4411a6d-9112-4c61-9b89-79750c2670b6 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:29.756409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc966c2-8ef5-482c-b265-9969c8543084 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:29.758446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc966c2-8ef5-482c-b265-9969c8543084 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-7bc966c2-8ef5-482c-b265-9969c8543084 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:36:29.772446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:29.774166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:29.775346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:29.775346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:29.775346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:36:29.775346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:36:29.775346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:36:29.775346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:36:29.775346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:36:29.775346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:36:29.775346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 18:36:29.775346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:29.775346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 549/1094] 10.222.0.72 () {56 vars in 1093 bytes} [Mon May 16 18:36:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:29.780067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc966c2-8ef5-482c-b265-9969c8543084 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:29.787008 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8e441-65bb-46fb-bd07-a96079bdd885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:29.787678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8e441-65bb-46fb-bd07-a96079bdd885 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:29.788020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8e441-65bb-46fb-bd07-a96079bdd885 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:29.788294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8e441-65bb-46fb-bd07-a96079bdd885 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:29.789075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8e441-65bb-46fb-bd07-a96079bdd885 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:29.789410 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8e441-65bb-46fb-bd07-a96079bdd885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:29.790727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8e441-65bb-46fb-bd07-a96079bdd885 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:29.803076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 546/1095] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:29.804138 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8e441-65bb-46fb-bd07-a96079bdd885 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:29.873613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc966c2-8ef5-482c-b265-9969c8543084 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:29.896813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8e441-65bb-46fb-bd07-a96079bdd885 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:29.905756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d7cf-ff11-49a4-ae73-15f986894859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:29.906422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d7cf-ff11-49a4-ae73-15f986894859 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:29.906701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d7cf-ff11-49a4-ae73-15f986894859 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:29.906972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d7cf-ff11-49a4-ae73-15f986894859 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:29.907837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90d7cf-ff11-49a4-ae73-15f986894859 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:29.908144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90d7cf-ff11-49a4-ae73-15f986894859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:29.909569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90d7cf-ff11-49a4-ae73-15f986894859 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:29.927337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 550/1096] 10.222.0.72 () {56 vars in 1133 bytes} [Mon May 16 18:36:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:29.928566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54e28c-94e6-4e2a-8ac1-013d7f327896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:29.929444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54e28c-94e6-4e2a-8ac1-013d7f327896 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:29.929753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54e28c-94e6-4e2a-8ac1-013d7f327896 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:29.929997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54e28c-94e6-4e2a-8ac1-013d7f327896 None admin] PATH_INFO: `/v3/users/bc780bf18fcf42f289b77aa88fea9412` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:29.931966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54e28c-94e6-4e2a-8ac1-013d7f327896 None admin] RBAC: Authorizing `identity:get_user(user_id=bc780bf18fcf42f289b77aa88fea9412)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:29.933418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54e28c-94e6-4e2a-8ac1-013d7f327896 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:29.939368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 547/1097] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:29 2022] GET /identity/v3/users/bc780bf18fcf42f289b77aa88fea9412 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:29.939528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d7cf-ff11-49a4-ae73-15f986894859 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:29.940550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54e28c-94e6-4e2a-8ac1-013d7f327896 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:30.034446 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54e28c-94e6-4e2a-8ac1-013d7f327896 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:30.035041 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d7cf-ff11-49a4-ae73-15f986894859 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:30.066725 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f462d-34b6-48dd-b09a-f4f4c2b6597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:30.067376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f462d-34b6-48dd-b09a-f4f4c2b6597a None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:30.067580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700608-adbe-42c3-81a8-0d8ce18601e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:30.067692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f462d-34b6-48dd-b09a-f4f4c2b6597a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:30.067954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f462d-34b6-48dd-b09a-f4f4c2b6597a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:30.068257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700608-adbe-42c3-81a8-0d8ce18601e9 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:30.068538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700608-adbe-42c3-81a8-0d8ce18601e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:30.068813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700608-adbe-42c3-81a8-0d8ce18601e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:30.132071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f462d-34b6-48dd-b09a-f4f4c2b6597a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:30.132463 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69700608-adbe-42c3-81a8-0d8ce18601e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:30.133513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f462d-34b6-48dd-b09a-f4f4c2b6597a None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:30.133889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69700608-adbe-42c3-81a8-0d8ce18601e9 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:30.225996 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 548/1098] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:36:30.228006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 551/1099] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:36:30.231681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f462d-34b6-48dd-b09a-f4f4c2b6597a None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:30.233600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700608-adbe-42c3-81a8-0d8ce18601e9 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:30.328737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f462d-34b6-48dd-b09a-f4f4c2b6597a None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:30.331549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700608-adbe-42c3-81a8-0d8ce18601e9 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:30.362193 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f62638-6ef9-4ec0-90cb-70e6661ae7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:30.363053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62638-6ef9-4ec0-90cb-70e6661ae7dc None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:30.363335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62638-6ef9-4ec0-90cb-70e6661ae7dc None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:30.363609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62638-6ef9-4ec0-90cb-70e6661ae7dc None admin] PATH_INFO: `/v3/projects/7f1718a49834488daec340d8a7abe921` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:30.364673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c885182-a310-431d-84c7-a99de9860977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:30.364794 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62638-6ef9-4ec0-90cb-70e6661ae7dc None admin] RBAC: Authorizing `identity:get_project(project_id=7f1718a49834488daec340d8a7abe921)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:30.365456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c885182-a310-431d-84c7-a99de9860977 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:30.365735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c885182-a310-431d-84c7-a99de9860977 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:30.366008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c885182-a310-431d-84c7-a99de9860977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:30.366211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62638-6ef9-4ec0-90cb-70e6661ae7dc None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:30.367931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 549/1100] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:36:30 2022] GET /identity/v3/projects/7f1718a49834488daec340d8a7abe921 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:30.374441 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f62638-6ef9-4ec0-90cb-70e6661ae7dc None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:30.379249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c885182-a310-431d-84c7-a99de9860977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:30.380756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c885182-a310-431d-84c7-a99de9860977 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-6c885182-a310-431d-84c7-a99de9860977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:36:30.398016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:30.399117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:30.400279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:36:30.400279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:36:30.400279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:36:30.400279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:30.400279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 552/1101] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:36:30.404816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c885182-a310-431d-84c7-a99de9860977 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:30.471162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f62638-6ef9-4ec0-90cb-70e6661ae7dc None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:30.499384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c885182-a310-431d-84c7-a99de9860977 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:30.504471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf56b36-c79e-411d-83e3-62a555013691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:30.505122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf56b36-c79e-411d-83e3-62a555013691 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:30.505405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf56b36-c79e-411d-83e3-62a555013691 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:30.505678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf56b36-c79e-411d-83e3-62a555013691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:30.506508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf56b36-c79e-411d-83e3-62a555013691 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=7f1718a49834488daec340d8a7abe921, user.id=bc780bf18fcf42f289b77aa88fea9412) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:30.506818 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf56b36-c79e-411d-83e3-62a555013691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:30.508294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf56b36-c79e-411d-83e3-62a555013691 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:30.514057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 550/1102] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:36:30 2022] GET /identity/v3/role_assignments?user.id=bc780bf18fcf42f289b77aa88fea9412&scope.project.id=7f1718a49834488daec340d8a7abe921&role.id=b104fd2e772843a0974990f965d8b589 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:30.531734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddfed6-1f57-4d97-83ce-6a7232861232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:30.532433 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddfed6-1f57-4d97-83ce-6a7232861232 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:30.532730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddfed6-1f57-4d97-83ce-6a7232861232 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:30.532980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddfed6-1f57-4d97-83ce-6a7232861232 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:30.533723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddfed6-1f57-4d97-83ce-6a7232861232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:30.534025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddfed6-1f57-4d97-83ce-6a7232861232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:30.535428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddfed6-1f57-4d97-83ce-6a7232861232 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:30.548429 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 553/1103] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:36:30.554470 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf56b36-c79e-411d-83e3-62a555013691 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:30.657578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf56b36-c79e-411d-83e3-62a555013691 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:30.692351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa404f5c-599e-429c-815e-36020e271ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:30.693151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404f5c-599e-429c-815e-36020e271ea7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:30.693430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404f5c-599e-429c-815e-36020e271ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:30.693699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404f5c-599e-429c-815e-36020e271ea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:30.700459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa404f5c-599e-429c-815e-36020e271ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:30.701892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa404f5c-599e-429c-815e-36020e271ea7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-aa404f5c-599e-429c-815e-36020e271ea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:36:30.716603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:30.717685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:30.718951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:36:30.718951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:36:30.718951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:36:30.718951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:36:30.718951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:36:30.718951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:36:30.718951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:36:30.718951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:30.718951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 551/1104] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:30.724598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddfed6-1f57-4d97-83ce-6a7232861232 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:30.823913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddfed6-1f57-4d97-83ce-6a7232861232 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:30.855360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569ed6f-15b9-4266-91e0-89b39f56532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:30.856049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569ed6f-15b9-4266-91e0-89b39f56532b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:30.856327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569ed6f-15b9-4266-91e0-89b39f56532b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:30.856596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569ed6f-15b9-4266-91e0-89b39f56532b None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:30.857376 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569ed6f-15b9-4266-91e0-89b39f56532b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:30.857678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569ed6f-15b9-4266-91e0-89b39f56532b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:30.859088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569ed6f-15b9-4266-91e0-89b39f56532b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:30.871170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 554/1105] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:30.877032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa404f5c-599e-429c-815e-36020e271ea7 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:30.971801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa404f5c-599e-429c-815e-36020e271ea7 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:31.003936 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0ba33-6450-499a-912a-3c8dafe2526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:31.004583 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0ba33-6450-499a-912a-3c8dafe2526e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:31.004864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0ba33-6450-499a-912a-3c8dafe2526e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:31.005137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0ba33-6450-499a-912a-3c8dafe2526e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:31.005968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0ba33-6450-499a-912a-3c8dafe2526e None admin] RBAC: Adding query filter params (role.id=be018b67ef8944b2959b4c5d0451f8cc, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=cc09bfcc0d8c4d20a156b3b08ffafa34) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:31.006279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0ba33-6450-499a-912a-3c8dafe2526e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:31.007684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0ba33-6450-499a-912a-3c8dafe2526e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:31.014048 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 552/1106] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:36:30 2022] GET /identity/v3/role_assignments?user.id=cc09bfcc0d8c4d20a156b3b08ffafa34&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=be018b67ef8944b2959b4c5d0451f8cc => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:32.770647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504f2c-aaef-4850-948b-a01c36eda899 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:32.771186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504f2c-aaef-4850-948b-a01c36eda899 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:32.771186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504f2c-aaef-4850-948b-a01c36eda899 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:32.772592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 555/1107] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:32.777763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582432c-029b-41b7-864e-f4759fbd9483 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:32.778175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582432c-029b-41b7-864e-f4759fbd9483 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:32.778308 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582432c-029b-41b7-864e-f4759fbd9483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:32.794955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-3582432c-029b-41b7-864e-f4759fbd9483 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:32.796140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3582432c-029b-41b7-864e-f4759fbd9483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:32.859586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 553/1108] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:32.884657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c504f2c-aaef-4850-948b-a01c36eda899 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:32.983874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c504f2c-aaef-4850-948b-a01c36eda899 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:33.016033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a928b-d9d9-45a7-a2f0-3a36df211ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:33.016821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a928b-d9d9-45a7-a2f0-3a36df211ac9 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:33.017101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a928b-d9d9-45a7-a2f0-3a36df211ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:33.017371 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a928b-d9d9-45a7-a2f0-3a36df211ac9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:33.018542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a928b-d9d9-45a7-a2f0-3a36df211ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:33.019994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a928b-d9d9-45a7-a2f0-3a36df211ac9 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:33.021647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 556/1109] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:33.027763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582432c-029b-41b7-864e-f4759fbd9483 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:33.120679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582432c-029b-41b7-864e-f4759fbd9483 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:33.152539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a555a-4c3d-42c2-8dab-3da89b6d0f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:33.153197 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a555a-4c3d-42c2-8dab-3da89b6d0f0b None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:33.153480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a555a-4c3d-42c2-8dab-3da89b6d0f0b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:33.153753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a555a-4c3d-42c2-8dab-3da89b6d0f0b None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:33.154467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a555a-4c3d-42c2-8dab-3da89b6d0f0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:33.155909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a555a-4c3d-42c2-8dab-3da89b6d0f0b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:33.175388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 554/1110] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:36:33 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:36:35.414631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78e3f1-898c-4da9-9a26-9c17a98d7cce None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:35.415226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78e3f1-898c-4da9-9a26-9c17a98d7cce None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:35.415226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78e3f1-898c-4da9-9a26-9c17a98d7cce None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:35.416613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 557/1111] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:35.421878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405fe47-5180-49f6-95a9-fb9c6f2a8650 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:35.422286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405fe47-5180-49f6-95a9-fb9c6f2a8650 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:35.422443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405fe47-5180-49f6-95a9-fb9c6f2a8650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:35.439151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b405fe47-5180-49f6-95a9-fb9c6f2a8650 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:35.440404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b405fe47-5180-49f6-95a9-fb9c6f2a8650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:35.502487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 555/1112] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:35.526182 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78e3f1-898c-4da9-9a26-9c17a98d7cce None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:35.624612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78e3f1-898c-4da9-9a26-9c17a98d7cce None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:35.656730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b8041-7754-403d-af4e-6b79ba500df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:35.657581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b8041-7754-403d-af4e-6b79ba500df1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:35.657862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b8041-7754-403d-af4e-6b79ba500df1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:35.658134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b8041-7754-403d-af4e-6b79ba500df1 None admin] PATH_INFO: `/v3/roles/004dfaca095a4141ae157de95aa6390a` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:35.659589 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b8041-7754-403d-af4e-6b79ba500df1 None admin] RBAC: Authorizing `identity:get_role(role_id=004dfaca095a4141ae157de95aa6390a)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:35.660988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b8041-7754-403d-af4e-6b79ba500df1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:35.662440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 558/1113] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:35 2022] GET /identity/v3/roles/004dfaca095a4141ae157de95aa6390a => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:35.669151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405fe47-5180-49f6-95a9-fb9c6f2a8650 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:35.762685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405fe47-5180-49f6-95a9-fb9c6f2a8650 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:35.794459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb5603-0b1c-4112-b695-e6fb20b32299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:35.795323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb5603-0b1c-4112-b695-e6fb20b32299 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:35.795607 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb5603-0b1c-4112-b695-e6fb20b32299 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:35.795913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb5603-0b1c-4112-b695-e6fb20b32299 None admin] PATH_INFO: `/v3/users/e4b82728baf64fc7974e3119b97cbfe4` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:35.808792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb5603-0b1c-4112-b695-e6fb20b32299 None admin] RBAC: Authorizing `identity:get_user(user_id=e4b82728baf64fc7974e3119b97cbfe4)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:35.810255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb5603-0b1c-4112-b695-e6fb20b32299 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:35.811906 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 556/1114] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:35 2022] GET /identity/v3/users/e4b82728baf64fc7974e3119b97cbfe4 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:35.817753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b8041-7754-403d-af4e-6b79ba500df1 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:35.912390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b8041-7754-403d-af4e-6b79ba500df1 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:35.945022 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706406cd-f80b-48a5-9226-81bb60a237c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:35.945681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706406cd-f80b-48a5-9226-81bb60a237c0 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:35.945971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706406cd-f80b-48a5-9226-81bb60a237c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:35.946247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706406cd-f80b-48a5-9226-81bb60a237c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:36.012341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706406cd-f80b-48a5-9226-81bb60a237c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:36.013794 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706406cd-f80b-48a5-9226-81bb60a237c0 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:36.106349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 559/1115] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:36:36.112311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb5603-0b1c-4112-b695-e6fb20b32299 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:36.205171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb5603-0b1c-4112-b695-e6fb20b32299 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:36.237603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884c9c4-2a1b-455b-ac66-5750511d6820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:36.238453 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c9c4-2a1b-455b-ac66-5750511d6820 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:36.238733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c9c4-2a1b-455b-ac66-5750511d6820 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:36.239005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884c9c4-2a1b-455b-ac66-5750511d6820 None admin] PATH_INFO: `/v3/projects/7f1718a49834488daec340d8a7abe921` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:36.240190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884c9c4-2a1b-455b-ac66-5750511d6820 None admin] RBAC: Authorizing `identity:get_project(project_id=7f1718a49834488daec340d8a7abe921)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:36.241714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884c9c4-2a1b-455b-ac66-5750511d6820 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:36.243419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 557/1116] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:36:36 2022] GET /identity/v3/projects/7f1718a49834488daec340d8a7abe921 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:36.249538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706406cd-f80b-48a5-9226-81bb60a237c0 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:36.342111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706406cd-f80b-48a5-9226-81bb60a237c0 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:36.374277 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488c980-7b54-4733-a08f-1cee71414e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:36.374909 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c980-7b54-4733-a08f-1cee71414e0a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:36.375186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c980-7b54-4733-a08f-1cee71414e0a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:36.375454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c980-7b54-4733-a08f-1cee71414e0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:36.376295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488c980-7b54-4733-a08f-1cee71414e0a None admin] RBAC: Adding query filter params (role.id=004dfaca095a4141ae157de95aa6390a, scope.project.id=7f1718a49834488daec340d8a7abe921, user.id=e4b82728baf64fc7974e3119b97cbfe4) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:36.376599 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488c980-7b54-4733-a08f-1cee71414e0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:36.377993 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488c980-7b54-4733-a08f-1cee71414e0a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:36.383161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 560/1117] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:36:36 2022] GET /identity/v3/role_assignments?user.id=e4b82728baf64fc7974e3119b97cbfe4&scope.project.id=7f1718a49834488daec340d8a7abe921&role.id=004dfaca095a4141ae157de95aa6390a => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:38.572553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234228-ea2e-45a1-a151-2f63c126566b None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:38.573098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234228-ea2e-45a1-a151-2f63c126566b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:38.573098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0234228-ea2e-45a1-a151-2f63c126566b None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:38.574465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 558/1118] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:38.579625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775559-754f-4851-96df-a754036e3e9b None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:38.580097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775559-754f-4851-96df-a754036e3e9b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:38.580201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775559-754f-4851-96df-a754036e3e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:38.596431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-7f775559-754f-4851-96df-a754036e3e9b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:38.597587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7f775559-754f-4851-96df-a754036e3e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:38.660802 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 561/1119] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:38.684171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234228-ea2e-45a1-a151-2f63c126566b None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:38.781016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0234228-ea2e-45a1-a151-2f63c126566b None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:38.812253 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a62e3-7adb-4ce7-aa7a-6522f763c161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:38.813093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a62e3-7adb-4ce7-aa7a-6522f763c161 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:38.813376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a62e3-7adb-4ce7-aa7a-6522f763c161 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:38.813650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a62e3-7adb-4ce7-aa7a-6522f763c161 None admin] PATH_INFO: `/v3/roles/004dfaca095a4141ae157de95aa6390a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:38.815103 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a62e3-7adb-4ce7-aa7a-6522f763c161 None admin] RBAC: Authorizing `identity:get_role(role_id=004dfaca095a4141ae157de95aa6390a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:38.816511 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a62e3-7adb-4ce7-aa7a-6522f763c161 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:38.817860 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 559/1120] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:38 2022] GET /identity/v3/roles/004dfaca095a4141ae157de95aa6390a => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:38.824220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775559-754f-4851-96df-a754036e3e9b None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:38.915953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775559-754f-4851-96df-a754036e3e9b None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:38.948430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c6fe0-ed98-4d6f-92ed-47d74cbf135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:38.949292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c6fe0-ed98-4d6f-92ed-47d74cbf135b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:38.949567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c6fe0-ed98-4d6f-92ed-47d74cbf135b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:38.949835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c6fe0-ed98-4d6f-92ed-47d74cbf135b None admin] PATH_INFO: `/v3/users/e4b82728baf64fc7974e3119b97cbfe4` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:38.950998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c6fe0-ed98-4d6f-92ed-47d74cbf135b None admin] RBAC: Authorizing `identity:get_user(user_id=e4b82728baf64fc7974e3119b97cbfe4)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:38.952441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c6fe0-ed98-4d6f-92ed-47d74cbf135b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:38.954035 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 562/1121] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:38 2022] GET /identity/v3/users/e4b82728baf64fc7974e3119b97cbfe4 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:38.959732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a62e3-7adb-4ce7-aa7a-6522f763c161 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:39.052519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a62e3-7adb-4ce7-aa7a-6522f763c161 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:39.085063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cd4f8-7ee2-421d-903f-848b2ae11a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:39.085849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cd4f8-7ee2-421d-903f-848b2ae11a00 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:39.086132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cd4f8-7ee2-421d-903f-848b2ae11a00 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:39.086409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cd4f8-7ee2-421d-903f-848b2ae11a00 None admin] PATH_INFO: `/v3/projects/7f1718a49834488daec340d8a7abe921` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:39.088195 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cd4f8-7ee2-421d-903f-848b2ae11a00 None admin] RBAC: Authorizing `identity:get_project(project_id=7f1718a49834488daec340d8a7abe921)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:39.089612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cd4f8-7ee2-421d-903f-848b2ae11a00 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:39.091289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 560/1122] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:36:38 2022] GET /identity/v3/projects/7f1718a49834488daec340d8a7abe921 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:39.097314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c6fe0-ed98-4d6f-92ed-47d74cbf135b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:39.190493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c6fe0-ed98-4d6f-92ed-47d74cbf135b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:39.222338 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308f1ed-69ae-4406-894f-5a9199f60319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:39.223216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308f1ed-69ae-4406-894f-5a9199f60319 None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:39.223497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308f1ed-69ae-4406-894f-5a9199f60319 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:39.223797 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308f1ed-69ae-4406-894f-5a9199f60319 None admin] PATH_INFO: `/v3/projects/7f1718a49834488daec340d8a7abe921/users/e4b82728baf64fc7974e3119b97cbfe4/roles/004dfaca095a4141ae157de95aa6390a` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:39.225957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308f1ed-69ae-4406-894f-5a9199f60319 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f1718a49834488daec340d8a7abe921, user_id=e4b82728baf64fc7974e3119b97cbfe4, role_id=004dfaca095a4141ae157de95aa6390a)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:39.227377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308f1ed-69ae-4406-894f-5a9199f60319 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:39.240099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 563/1123] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:36:39 2022] PUT /identity/v3/projects/7f1718a49834488daec340d8a7abe921/users/e4b82728baf64fc7974e3119b97cbfe4/roles/004dfaca095a4141ae157de95aa6390a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:36:41.454746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042429b9-d06d-4d56-af6e-274d4f9e9062 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:41.455306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042429b9-d06d-4d56-af6e-274d4f9e9062 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:41.455306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042429b9-d06d-4d56-af6e-274d4f9e9062 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:41.456779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 561/1124] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:41.463071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cafc23-39ae-41e5-b8c6-ec12ed7e1377 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:41.463458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cafc23-39ae-41e5-b8c6-ec12ed7e1377 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:41.463647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cafc23-39ae-41e5-b8c6-ec12ed7e1377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:41.480741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c3cafc23-39ae-41e5-b8c6-ec12ed7e1377 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:41.481916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c3cafc23-39ae-41e5-b8c6-ec12ed7e1377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:41.546847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 564/1125] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:41.570562 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042429b9-d06d-4d56-af6e-274d4f9e9062 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:41.665936 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042429b9-d06d-4d56-af6e-274d4f9e9062 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:41.697709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cbdd2-7175-47b5-a204-ff3f89f5dd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:41.698548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cbdd2-7175-47b5-a204-ff3f89f5dd27 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:41.698831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cbdd2-7175-47b5-a204-ff3f89f5dd27 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:41.699106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cbdd2-7175-47b5-a204-ff3f89f5dd27 None admin] PATH_INFO: `/v3/roles/004dfaca095a4141ae157de95aa6390a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:41.700574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cbdd2-7175-47b5-a204-ff3f89f5dd27 None admin] RBAC: Authorizing `identity:get_role(role_id=004dfaca095a4141ae157de95aa6390a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:41.701932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cbdd2-7175-47b5-a204-ff3f89f5dd27 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:41.703298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 562/1126] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:41 2022] GET /identity/v3/roles/004dfaca095a4141ae157de95aa6390a => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:41.709008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cafc23-39ae-41e5-b8c6-ec12ed7e1377 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:41.801550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cafc23-39ae-41e5-b8c6-ec12ed7e1377 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:41.833326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60855008-5d9f-4704-91ae-f79e37c249c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:41.834179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855008-5d9f-4704-91ae-f79e37c249c9 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:41.834455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855008-5d9f-4704-91ae-f79e37c249c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:41.834724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855008-5d9f-4704-91ae-f79e37c249c9 None admin] PATH_INFO: `/v3/users/e4b82728baf64fc7974e3119b97cbfe4` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:41.835918 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60855008-5d9f-4704-91ae-f79e37c249c9 None admin] RBAC: Authorizing `identity:get_user(user_id=e4b82728baf64fc7974e3119b97cbfe4)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:41.837379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60855008-5d9f-4704-91ae-f79e37c249c9 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:41.839132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 565/1127] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:41 2022] GET /identity/v3/users/e4b82728baf64fc7974e3119b97cbfe4 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:41.844934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cbdd2-7175-47b5-a204-ff3f89f5dd27 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:41.940040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cbdd2-7175-47b5-a204-ff3f89f5dd27 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:41.971774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42e35c-b33c-4bd7-a919-4192578d5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:41.972364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42e35c-b33c-4bd7-a919-4192578d5d99 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:41.972649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42e35c-b33c-4bd7-a919-4192578d5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:41.972924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42e35c-b33c-4bd7-a919-4192578d5d99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:42.036383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42e35c-b33c-4bd7-a919-4192578d5d99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:42.037823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42e35c-b33c-4bd7-a919-4192578d5d99 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:42.129209 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 563/1128] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:36:42.135514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60855008-5d9f-4704-91ae-f79e37c249c9 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:42.230057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60855008-5d9f-4704-91ae-f79e37c249c9 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:42.262552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48ea93-5c77-44ba-988e-2498c0f80a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:42.263403 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48ea93-5c77-44ba-988e-2498c0f80a1c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:42.263686 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48ea93-5c77-44ba-988e-2498c0f80a1c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:42.263993 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48ea93-5c77-44ba-988e-2498c0f80a1c None admin] PATH_INFO: `/v3/projects/7f1718a49834488daec340d8a7abe921` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:42.265166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48ea93-5c77-44ba-988e-2498c0f80a1c None admin] RBAC: Authorizing `identity:get_project(project_id=7f1718a49834488daec340d8a7abe921)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:42.266583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48ea93-5c77-44ba-988e-2498c0f80a1c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:42.268279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 566/1129] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:36:42 2022] GET /identity/v3/projects/7f1718a49834488daec340d8a7abe921 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:42.274219 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42e35c-b33c-4bd7-a919-4192578d5d99 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:42.365901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42e35c-b33c-4bd7-a919-4192578d5d99 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:42.397326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0b8fe-8afd-44d5-bb8c-3d13fec2b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:42.397964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b8fe-8afd-44d5-bb8c-3d13fec2b728 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:42.398247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b8fe-8afd-44d5-bb8c-3d13fec2b728 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:42.398520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b8fe-8afd-44d5-bb8c-3d13fec2b728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:42.399344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0b8fe-8afd-44d5-bb8c-3d13fec2b728 None admin] RBAC: Adding query filter params (role.id=004dfaca095a4141ae157de95aa6390a, scope.project.id=7f1718a49834488daec340d8a7abe921, user.id=e4b82728baf64fc7974e3119b97cbfe4) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:42.400317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0b8fe-8afd-44d5-bb8c-3d13fec2b728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:42.401733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0b8fe-8afd-44d5-bb8c-3d13fec2b728 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:42.407286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 564/1130] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:36:42 2022] GET /identity/v3/role_assignments?user.id=e4b82728baf64fc7974e3119b97cbfe4&scope.project.id=7f1718a49834488daec340d8a7abe921&role.id=004dfaca095a4141ae157de95aa6390a => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:44.614806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b410c-eb47-4b03-a434-14ce4e574513 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:44.615353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b410c-eb47-4b03-a434-14ce4e574513 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:44.615353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b410c-eb47-4b03-a434-14ce4e574513 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:44.616750 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 567/1131] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:44.622506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf5ed4-f537-4574-8b4e-3be7c766e353 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:44.622964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf5ed4-f537-4574-8b4e-3be7c766e353 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:44.623058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf5ed4-f537-4574-8b4e-3be7c766e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:44.639110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-3daf5ed4-f537-4574-8b4e-3be7c766e353 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:44.640311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3daf5ed4-f537-4574-8b4e-3be7c766e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:44.703134 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 565/1132] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:44.726658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b410c-eb47-4b03-a434-14ce4e574513 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:44.823193 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b410c-eb47-4b03-a434-14ce4e574513 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:44.855112 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2442bfc-1ad4-468d-8a3d-07546a85e020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:44.855917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442bfc-1ad4-468d-8a3d-07546a85e020 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:44.856201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442bfc-1ad4-468d-8a3d-07546a85e020 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:44.856476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442bfc-1ad4-468d-8a3d-07546a85e020 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:44.857633 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2442bfc-1ad4-468d-8a3d-07546a85e020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:44.859049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2442bfc-1ad4-468d-8a3d-07546a85e020 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:44.860672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 568/1133] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:44.866360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf5ed4-f537-4574-8b4e-3be7c766e353 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:44.958333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf5ed4-f537-4574-8b4e-3be7c766e353 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:44.990959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23042e13-b0be-473f-930d-5e5b6b075b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:44.991616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23042e13-b0be-473f-930d-5e5b6b075b97 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:44.991928 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23042e13-b0be-473f-930d-5e5b6b075b97 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:44.992210 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23042e13-b0be-473f-930d-5e5b6b075b97 None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:44.992922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23042e13-b0be-473f-930d-5e5b6b075b97 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:44.994739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23042e13-b0be-473f-930d-5e5b6b075b97 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:45.018356 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 566/1134] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:36:44 2022] POST /identity/v3/projects => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:36:47.240534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d0e44-e791-4d06-8011-be7d8b9ec55c None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:47.241052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d0e44-e791-4d06-8011-be7d8b9ec55c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:47.241052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d0e44-e791-4d06-8011-be7d8b9ec55c None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:47.242357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 569/1135] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:47.248144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ef2f-e6d1-4acc-9f7e-30a8590bacfd None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:47.248600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ef2f-e6d1-4acc-9f7e-30a8590bacfd None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:47.248696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ef2f-e6d1-4acc-9f7e-30a8590bacfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:47.265421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-9d64ef2f-e6d1-4acc-9f7e-30a8590bacfd None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:47.266592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9d64ef2f-e6d1-4acc-9f7e-30a8590bacfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:47.328778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 567/1136] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:47.354300 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d0e44-e791-4d06-8011-be7d8b9ec55c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:47.451680 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d0e44-e791-4d06-8011-be7d8b9ec55c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:47.483582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b58715-03cf-4f32-9ed4-94a11df74f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:47.484403 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58715-03cf-4f32-9ed4-94a11df74f8f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:47.484680 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58715-03cf-4f32-9ed4-94a11df74f8f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:47.484949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58715-03cf-4f32-9ed4-94a11df74f8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:47.486097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b58715-03cf-4f32-9ed4-94a11df74f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:47.487508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b58715-03cf-4f32-9ed4-94a11df74f8f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:47.489122 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 570/1137] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:36:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:47.495422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64ef2f-e6d1-4acc-9f7e-30a8590bacfd None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:47.587859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64ef2f-e6d1-4acc-9f7e-30a8590bacfd None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:47.620197 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b771-6ff8-4dfc-b7f5-743bf9b962d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:47.620946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b771-6ff8-4dfc-b7f5-743bf9b962d0 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:47.621233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b771-6ff8-4dfc-b7f5-743bf9b962d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:47.621509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b771-6ff8-4dfc-b7f5-743bf9b962d0 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:47.622208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b771-6ff8-4dfc-b7f5-743bf9b962d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:47.623614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b771-6ff8-4dfc-b7f5-743bf9b962d0 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:47.642361 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 568/1138] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:36:47 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:36:49.934973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213b813-588f-42cc-b865-74dbb8d79a5c None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:49.935368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213b813-588f-42cc-b865-74dbb8d79a5c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:49.935525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213b813-588f-42cc-b865-74dbb8d79a5c None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:49.936930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 571/1139] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:49.942317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cffebd-e79c-493d-96d5-84284defb891 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:49.942740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cffebd-e79c-493d-96d5-84284defb891 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:49.942875 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cffebd-e79c-493d-96d5-84284defb891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:49.959877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f6cffebd-e79c-493d-96d5-84284defb891 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:49.961066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f6cffebd-e79c-493d-96d5-84284defb891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:50.025463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 569/1140] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:50.048915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213b813-588f-42cc-b865-74dbb8d79a5c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:50.145255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213b813-588f-42cc-b865-74dbb8d79a5c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:50.176463 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1fb95-ec02-4104-88ed-d266b8a1b828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:50.177333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fb95-ec02-4104-88ed-d266b8a1b828 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:50.177612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fb95-ec02-4104-88ed-d266b8a1b828 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:50.178043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fb95-ec02-4104-88ed-d266b8a1b828 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:50.188685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1fb95-ec02-4104-88ed-d266b8a1b828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-2ea1fb95-ec02-4104-88ed-d266b8a1b828 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:50.196828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:50.197947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:50.199186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 572/1141] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:36:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:50.204033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cffebd-e79c-493d-96d5-84284defb891 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:50.295833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cffebd-e79c-493d-96d5-84284defb891 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:50.328661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f743b-58ed-4670-a7b8-5bc1fbbf3189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:50.329318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f743b-58ed-4670-a7b8-5bc1fbbf3189 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:50.329595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f743b-58ed-4670-a7b8-5bc1fbbf3189 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:50.329866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f743b-58ed-4670-a7b8-5bc1fbbf3189 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:50.330604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f743b-58ed-4670-a7b8-5bc1fbbf3189 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:50.330905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f743b-58ed-4670-a7b8-5bc1fbbf3189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:50.332281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f743b-58ed-4670-a7b8-5bc1fbbf3189 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:50.340065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 570/1142] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:36:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:50.345933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1fb95-ec02-4104-88ed-d266b8a1b828 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:50.438316 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1fb95-ec02-4104-88ed-d266b8a1b828 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:50.469435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81395f87-f0d9-4c47-b3f7-7e17a887aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:50.470222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81395f87-f0d9-4c47-b3f7-7e17a887aa65 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:50.470496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81395f87-f0d9-4c47-b3f7-7e17a887aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:50.470762 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81395f87-f0d9-4c47-b3f7-7e17a887aa65 None admin] PATH_INFO: `/v3/users/54092be2da174369944ecb182d96fadc` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:50.483047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81395f87-f0d9-4c47-b3f7-7e17a887aa65 None admin] RBAC: Authorizing `identity:get_user(user_id=54092be2da174369944ecb182d96fadc)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:50.484491 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81395f87-f0d9-4c47-b3f7-7e17a887aa65 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:50.486085 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 573/1143] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:50 2022] GET /identity/v3/users/54092be2da174369944ecb182d96fadc => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:50.491663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f743b-58ed-4670-a7b8-5bc1fbbf3189 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:50.586049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f743b-58ed-4670-a7b8-5bc1fbbf3189 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:50.617758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1700f5-d0b6-4c9e-b797-5637835ec980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:50.619014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1700f5-d0b6-4c9e-b797-5637835ec980 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:50.619296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1700f5-d0b6-4c9e-b797-5637835ec980 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:50.619576 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1700f5-d0b6-4c9e-b797-5637835ec980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:50.683000 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1700f5-d0b6-4c9e-b797-5637835ec980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:50.684468 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1700f5-d0b6-4c9e-b797-5637835ec980 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:50.778518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 571/1144] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:36:50.784296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81395f87-f0d9-4c47-b3f7-7e17a887aa65 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:50.877363 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81395f87-f0d9-4c47-b3f7-7e17a887aa65 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:50.908958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58715c0-9685-408a-8ff0-62f4dc623c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:50.909793 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58715c0-9685-408a-8ff0-62f4dc623c79 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:50.910067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58715c0-9685-408a-8ff0-62f4dc623c79 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:50.910336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58715c0-9685-408a-8ff0-62f4dc623c79 None admin] PATH_INFO: `/v3/projects/bf32927f34ba4ff1a181d41e3f20da44` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:50.911495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58715c0-9685-408a-8ff0-62f4dc623c79 None admin] RBAC: Authorizing `identity:get_project(project_id=bf32927f34ba4ff1a181d41e3f20da44)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:50.912948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58715c0-9685-408a-8ff0-62f4dc623c79 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:50.914621 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 574/1145] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:36:50 2022] GET /identity/v3/projects/bf32927f34ba4ff1a181d41e3f20da44 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:50.920706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1700f5-d0b6-4c9e-b797-5637835ec980 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:51.020150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1700f5-d0b6-4c9e-b797-5637835ec980 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:51.056735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b098860-56ba-488a-985f-7f86306269a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:51.057588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b098860-56ba-488a-985f-7f86306269a9 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:51.058007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b098860-56ba-488a-985f-7f86306269a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:51.058427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b098860-56ba-488a-985f-7f86306269a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:51.059616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b098860-56ba-488a-985f-7f86306269a9 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=bf32927f34ba4ff1a181d41e3f20da44, user.id=54092be2da174369944ecb182d96fadc) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:51.060119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b098860-56ba-488a-985f-7f86306269a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:51.061882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b098860-56ba-488a-985f-7f86306269a9 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:51.068080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 572/1146] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:36:50 2022] GET /identity/v3/role_assignments?user.id=54092be2da174369944ecb182d96fadc&scope.project.id=bf32927f34ba4ff1a181d41e3f20da44&role.id=b104fd2e772843a0974990f965d8b589 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:53.255294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e921f-3a20-405e-b7eb-ac50fe13c730 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:53.255834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e921f-3a20-405e-b7eb-ac50fe13c730 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:53.255834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e921f-3a20-405e-b7eb-ac50fe13c730 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:53.257138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 575/1147] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:53.262437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f938fb-2f43-4c2b-a226-3a29ff859e5d None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:53.262853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f938fb-2f43-4c2b-a226-3a29ff859e5d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:53.263008 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f938fb-2f43-4c2b-a226-3a29ff859e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:53.279731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-50f938fb-2f43-4c2b-a226-3a29ff859e5d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:53.280896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-50f938fb-2f43-4c2b-a226-3a29ff859e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:53.344121 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 573/1148] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:53.367302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e921f-3a20-405e-b7eb-ac50fe13c730 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:53.468059 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e921f-3a20-405e-b7eb-ac50fe13c730 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:53.500521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a737d1-f873-421b-9f0b-426426688036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:53.501307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a737d1-f873-421b-9f0b-426426688036 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:53.501587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a737d1-f873-421b-9f0b-426426688036 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:53.501857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a737d1-f873-421b-9f0b-426426688036 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:53.512022 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a737d1-f873-421b-9f0b-426426688036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-c8a737d1-f873-421b-9f0b-426426688036 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:53.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:53.520622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:36:53.521738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 576/1149] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:36:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:53.527531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f938fb-2f43-4c2b-a226-3a29ff859e5d None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:53.619565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f938fb-2f43-4c2b-a226-3a29ff859e5d None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:53.651502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3284d1f-943b-4ebc-800b-633978a3bd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:53.652191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3284d1f-943b-4ebc-800b-633978a3bd96 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:53.652477 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3284d1f-943b-4ebc-800b-633978a3bd96 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:53.652754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3284d1f-943b-4ebc-800b-633978a3bd96 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:53.653495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3284d1f-943b-4ebc-800b-633978a3bd96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:53.653799 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3284d1f-943b-4ebc-800b-633978a3bd96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:53.655154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3284d1f-943b-4ebc-800b-633978a3bd96 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:53.662755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 574/1150] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:53.668532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a737d1-f873-421b-9f0b-426426688036 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:53.764844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a737d1-f873-421b-9f0b-426426688036 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:53.796485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9ccbe-1af2-47e9-8807-02b1e3c7bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:53.797343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9ccbe-1af2-47e9-8807-02b1e3c7bd64 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:53.797619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9ccbe-1af2-47e9-8807-02b1e3c7bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:53.797887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9ccbe-1af2-47e9-8807-02b1e3c7bd64 None admin] PATH_INFO: `/v3/users/54092be2da174369944ecb182d96fadc` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:53.799043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9ccbe-1af2-47e9-8807-02b1e3c7bd64 None admin] RBAC: Authorizing `identity:get_user(user_id=54092be2da174369944ecb182d96fadc)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:53.800482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9ccbe-1af2-47e9-8807-02b1e3c7bd64 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:53.802080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 577/1151] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:53 2022] GET /identity/v3/users/54092be2da174369944ecb182d96fadc => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:53.808257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3284d1f-943b-4ebc-800b-633978a3bd96 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:53.901268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3284d1f-943b-4ebc-800b-633978a3bd96 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:53.932574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cc085-b9cb-4406-8a78-39e052c5b82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:53.933426 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cc085-b9cb-4406-8a78-39e052c5b82c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:53.933706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cc085-b9cb-4406-8a78-39e052c5b82c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:53.933980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cc085-b9cb-4406-8a78-39e052c5b82c None admin] PATH_INFO: `/v3/projects/bf32927f34ba4ff1a181d41e3f20da44` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:53.935128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cc085-b9cb-4406-8a78-39e052c5b82c None admin] RBAC: Authorizing `identity:get_project(project_id=bf32927f34ba4ff1a181d41e3f20da44)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:53.936574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cc085-b9cb-4406-8a78-39e052c5b82c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:53.938249 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 575/1152] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:36:53 2022] GET /identity/v3/projects/bf32927f34ba4ff1a181d41e3f20da44 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:53.944166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9ccbe-1af2-47e9-8807-02b1e3c7bd64 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:54.039255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9ccbe-1af2-47e9-8807-02b1e3c7bd64 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:54.070531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811759c-f121-470d-9ba0-7ae8c3d89bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:54.072104 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811759c-f121-470d-9ba0-7ae8c3d89bde None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:54.072378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811759c-f121-470d-9ba0-7ae8c3d89bde None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:54.072647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811759c-f121-470d-9ba0-7ae8c3d89bde None admin] PATH_INFO: `/v3/projects/bf32927f34ba4ff1a181d41e3f20da44/users/54092be2da174369944ecb182d96fadc/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:54.074559 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811759c-f121-470d-9ba0-7ae8c3d89bde None admin] RBAC: Authorizing `identity:create_grant(project_id=bf32927f34ba4ff1a181d41e3f20da44, user_id=54092be2da174369944ecb182d96fadc, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:54.076016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811759c-f121-470d-9ba0-7ae8c3d89bde None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:54.089496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 578/1153] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:36:53 2022] PUT /identity/v3/projects/bf32927f34ba4ff1a181d41e3f20da44/users/54092be2da174369944ecb182d96fadc/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:36:56.280330 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978225c-0a5f-44de-9db0-632bcb38ea50 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:56.280845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978225c-0a5f-44de-9db0-632bcb38ea50 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:56.280845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978225c-0a5f-44de-9db0-632bcb38ea50 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:56.282143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 576/1154] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:56.287534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf327484-5522-4d92-acc8-86056222c38c None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:56.287969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf327484-5522-4d92-acc8-86056222c38c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:56.288125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf327484-5522-4d92-acc8-86056222c38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:56.305322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-bf327484-5522-4d92-acc8-86056222c38c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:56.306566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-bf327484-5522-4d92-acc8-86056222c38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:56.369892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 579/1155] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:56.393224 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978225c-0a5f-44de-9db0-632bcb38ea50 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:56.493735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978225c-0a5f-44de-9db0-632bcb38ea50 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:56.526320 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b55b65-d9c8-476b-b334-cbfd282bd36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:56.527097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b55b65-d9c8-476b-b334-cbfd282bd36b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:56.527383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b55b65-d9c8-476b-b334-cbfd282bd36b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:56.527659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b55b65-d9c8-476b-b334-cbfd282bd36b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:56.537287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b55b65-d9c8-476b-b334-cbfd282bd36b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-76b55b65-d9c8-476b-b334-cbfd282bd36b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:36:56.544927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:36:56.546050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:36:56.547091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 577/1156] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:36:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:36:56.552249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf327484-5522-4d92-acc8-86056222c38c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:56.643543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf327484-5522-4d92-acc8-86056222c38c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:56.675127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645a7ed-a0ed-46c9-a4f9-fa322edee505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:56.675803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a7ed-a0ed-46c9-a4f9-fa322edee505 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:56.676082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a7ed-a0ed-46c9-a4f9-fa322edee505 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:56.676351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645a7ed-a0ed-46c9-a4f9-fa322edee505 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:56.677165 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645a7ed-a0ed-46c9-a4f9-fa322edee505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:56.677468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645a7ed-a0ed-46c9-a4f9-fa322edee505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:56.678824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645a7ed-a0ed-46c9-a4f9-fa322edee505 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:56.686474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 580/1157] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:36:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:56.692133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b55b65-d9c8-476b-b334-cbfd282bd36b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:56.797295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b55b65-d9c8-476b-b334-cbfd282bd36b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:56.828630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c7852-da71-4dc3-a6b5-d8bd9e961227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:56.829498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7852-da71-4dc3-a6b5-d8bd9e961227 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:56.829784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7852-da71-4dc3-a6b5-d8bd9e961227 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:56.830062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c7852-da71-4dc3-a6b5-d8bd9e961227 None admin] PATH_INFO: `/v3/users/54092be2da174369944ecb182d96fadc` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:56.831230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c7852-da71-4dc3-a6b5-d8bd9e961227 None admin] RBAC: Authorizing `identity:get_user(user_id=54092be2da174369944ecb182d96fadc)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:56.832691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c7852-da71-4dc3-a6b5-d8bd9e961227 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:56.834314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 578/1158] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:36:56 2022] GET /identity/v3/users/54092be2da174369944ecb182d96fadc => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:56.840655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645a7ed-a0ed-46c9-a4f9-fa322edee505 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:56.934728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645a7ed-a0ed-46c9-a4f9-fa322edee505 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:56.966231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19771a-7c5a-41a2-acef-65ce51e0d84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:56.966868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19771a-7c5a-41a2-acef-65ce51e0d84e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:56.967148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19771a-7c5a-41a2-acef-65ce51e0d84e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:56.967422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19771a-7c5a-41a2-acef-65ce51e0d84e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:57.031938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19771a-7c5a-41a2-acef-65ce51e0d84e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:57.033366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19771a-7c5a-41a2-acef-65ce51e0d84e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:57.124670 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 581/1159] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:36:57.130494 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c7852-da71-4dc3-a6b5-d8bd9e961227 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:57.224990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c7852-da71-4dc3-a6b5-d8bd9e961227 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:57.256475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bf048-0840-4e87-86c5-6e57d9419006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:57.257318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bf048-0840-4e87-86c5-6e57d9419006 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:57.257601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bf048-0840-4e87-86c5-6e57d9419006 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:57.257876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bf048-0840-4e87-86c5-6e57d9419006 None admin] PATH_INFO: `/v3/projects/bf32927f34ba4ff1a181d41e3f20da44` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:57.259872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bf048-0840-4e87-86c5-6e57d9419006 None admin] RBAC: Authorizing `identity:get_project(project_id=bf32927f34ba4ff1a181d41e3f20da44)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:57.261284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bf048-0840-4e87-86c5-6e57d9419006 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:57.262982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 579/1160] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:36:57 2022] GET /identity/v3/projects/bf32927f34ba4ff1a181d41e3f20da44 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:57.269083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19771a-7c5a-41a2-acef-65ce51e0d84e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:57.361940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19771a-7c5a-41a2-acef-65ce51e0d84e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:57.393371 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd5495-f410-4b39-98ea-5449fcee5321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:57.393948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd5495-f410-4b39-98ea-5449fcee5321 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:57.394224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd5495-f410-4b39-98ea-5449fcee5321 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:57.394492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd5495-f410-4b39-98ea-5449fcee5321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:57.395310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd5495-f410-4b39-98ea-5449fcee5321 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=bf32927f34ba4ff1a181d41e3f20da44, user.id=54092be2da174369944ecb182d96fadc) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:36:57.395614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd5495-f410-4b39-98ea-5449fcee5321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:57.397045 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd5495-f410-4b39-98ea-5449fcee5321 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:36:57.402678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 582/1161] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:36:57 2022] GET /identity/v3/role_assignments?user.id=54092be2da174369944ecb182d96fadc&scope.project.id=bf32927f34ba4ff1a181d41e3f20da44&role.id=b104fd2e772843a0974990f965d8b589 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:36:59.628474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6633-26e9-4c5a-9634-8a6eb8f2ccc4 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:59.629071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6633-26e9-4c5a-9634-8a6eb8f2ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:59.629071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6633-26e9-4c5a-9634-8a6eb8f2ccc4 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:59.630395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 580/1162] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:36:59.635562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a865333-314e-4880-9f01-891ed5999610 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:59.636001 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a865333-314e-4880-9f01-891ed5999610 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:59.636166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a865333-314e-4880-9f01-891ed5999610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:59.652835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8a865333-314e-4880-9f01-891ed5999610 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:36:59.654014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8a865333-314e-4880-9f01-891ed5999610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:36:59.719954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 583/1163] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:36:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:36:59.743771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae6633-26e9-4c5a-9634-8a6eb8f2ccc4 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:36:59.838479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae6633-26e9-4c5a-9634-8a6eb8f2ccc4 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:36:59.871046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9ef1e-45aa-49f7-8abd-053498c8739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:36:59.871679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ef1e-45aa-49f7-8abd-053498c8739d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:36:59.871995 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ef1e-45aa-49f7-8abd-053498c8739d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:36:59.872273 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ef1e-45aa-49f7-8abd-053498c8739d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:36:59.934722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9ef1e-45aa-49f7-8abd-053498c8739d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:36:59.936200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9ef1e-45aa-49f7-8abd-053498c8739d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:00.028002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 581/1164] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:36:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:37:00.033989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a865333-314e-4880-9f01-891ed5999610 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:00.127549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a865333-314e-4880-9f01-891ed5999610 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:00.159717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd69ad-a7d8-43ae-acde-353af2c1333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:00.160528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd69ad-a7d8-43ae-acde-353af2c1333c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:00.160804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd69ad-a7d8-43ae-acde-353af2c1333c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:00.161073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd69ad-a7d8-43ae-acde-353af2c1333c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:00.168021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd69ad-a7d8-43ae-acde-353af2c1333c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:00.169436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd69ad-a7d8-43ae-acde-353af2c1333c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-10bd69ad-a7d8-43ae-acde-353af2c1333c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:37:00.182998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:37:00.184321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:37:00.185447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 584/1165] 10.222.0.72 () {56 vars in 1117 bytes} [Mon May 16 18:37:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:37:00.190160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9ef1e-45aa-49f7-8abd-053498c8739d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:00.283515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9ef1e-45aa-49f7-8abd-053498c8739d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:00.314729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dda8db-fb83-48c2-8f7b-a04a52511b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:00.315381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dda8db-fb83-48c2-8f7b-a04a52511b9e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:00.315664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dda8db-fb83-48c2-8f7b-a04a52511b9e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:00.315972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dda8db-fb83-48c2-8f7b-a04a52511b9e None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:00.316691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dda8db-fb83-48c2-8f7b-a04a52511b9e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:37:00.316997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dda8db-fb83-48c2-8f7b-a04a52511b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:00.318352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dda8db-fb83-48c2-8f7b-a04a52511b9e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:00.325677 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 582/1166] 10.222.0.72 () {56 vars in 1115 bytes} [Mon May 16 18:37:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:37:02.526953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999f268-459d-412b-a5d7-c2e7ac9d91c8 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:02.527521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999f268-459d-412b-a5d7-c2e7ac9d91c8 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:02.527521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999f268-459d-412b-a5d7-c2e7ac9d91c8 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:02.528904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 585/1167] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:37:02.534525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a5d69-fa5b-4df9-8e49-3b7ac3ee6c3e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:02.534955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a5d69-fa5b-4df9-8e49-3b7ac3ee6c3e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:02.535070 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a5d69-fa5b-4df9-8e49-3b7ac3ee6c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:02.551854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-ec4a5d69-fa5b-4df9-8e49-3b7ac3ee6c3e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:37:02.553024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ec4a5d69-fa5b-4df9-8e49-3b7ac3ee6c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:37:02.616171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 583/1168] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:37:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:37:02.639224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999f268-459d-412b-a5d7-c2e7ac9d91c8 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:02.735945 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999f268-459d-412b-a5d7-c2e7ac9d91c8 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:02.767484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77b3ce-bc20-4947-b27c-42780ab90329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:02.768156 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77b3ce-bc20-4947-b27c-42780ab90329 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:02.768435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77b3ce-bc20-4947-b27c-42780ab90329 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:02.768706 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77b3ce-bc20-4947-b27c-42780ab90329 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:02.769439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77b3ce-bc20-4947-b27c-42780ab90329 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:02.770790 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77b3ce-bc20-4947-b27c-42780ab90329 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:02.784878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 586/1169] 10.222.0.72 () {60 vars in 1138 bytes} [Mon May 16 18:37:02 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:37:05.035664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4fecd-944c-49d6-ac29-fbf57eae5d73 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:05.036229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4fecd-944c-49d6-ac29-fbf57eae5d73 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:05.036331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4fecd-944c-49d6-ac29-fbf57eae5d73 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:05.037634 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 584/1170] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:37:05.043578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03fc1-00cb-4bd7-a66e-9721c0ad0d88 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:05.044050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03fc1-00cb-4bd7-a66e-9721c0ad0d88 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:05.044144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d03fc1-00cb-4bd7-a66e-9721c0ad0d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:05.061422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-71d03fc1-00cb-4bd7-a66e-9721c0ad0d88 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:37:05.062580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-71d03fc1-00cb-4bd7-a66e-9721c0ad0d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:37:05.124816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 587/1171] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:37:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:37:05.147610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4fecd-944c-49d6-ac29-fbf57eae5d73 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:05.242098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4fecd-944c-49d6-ac29-fbf57eae5d73 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:05.272699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894d74b-2564-4c5a-b1b9-77a8318c6e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:05.273544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d74b-2564-4c5a-b1b9-77a8318c6e67 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:05.274345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d74b-2564-4c5a-b1b9-77a8318c6e67 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:05.274619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d74b-2564-4c5a-b1b9-77a8318c6e67 None admin] PATH_INFO: `/v3/domains/7830ddd4b8d64792b42b9de225ffc65f` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:05.284272 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894d74b-2564-4c5a-b1b9-77a8318c6e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7830ddd4b8d64792b42b9de225ffc65f)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:05.285699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894d74b-2564-4c5a-b1b9-77a8318c6e67 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:05.287293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 585/1172] 10.222.0.72 () {56 vars in 1183 bytes} [Mon May 16 18:37:05 2022] GET /identity/v3/domains/7830ddd4b8d64792b42b9de225ffc65f => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:37:05.294160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d03fc1-00cb-4bd7-a66e-9721c0ad0d88 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:05.389929 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d03fc1-00cb-4bd7-a66e-9721c0ad0d88 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:05.423082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b0736-c578-4106-8813-ea188ae2eab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:05.423755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b0736-c578-4106-8813-ea188ae2eab2 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:05.424043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b0736-c578-4106-8813-ea188ae2eab2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:05.424319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b0736-c578-4106-8813-ea188ae2eab2 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:05.425021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b0736-c578-4106-8813-ea188ae2eab2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:05.426433 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b0736-c578-4106-8813-ea188ae2eab2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:05.450677 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 588/1173] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:37:05 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:37:07.686699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af4522-df69-4f34-b70f-bbaa9b8dd7c5 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:07.687267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af4522-df69-4f34-b70f-bbaa9b8dd7c5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:07.687267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af4522-df69-4f34-b70f-bbaa9b8dd7c5 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:07.688634 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 586/1174] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:37:07.693784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177805d-500b-486b-8f2c-bf00c27f6663 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:07.694232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177805d-500b-486b-8f2c-bf00c27f6663 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:07.694332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177805d-500b-486b-8f2c-bf00c27f6663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:07.711236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-7177805d-500b-486b-8f2c-bf00c27f6663 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:37:07.712479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7177805d-500b-486b-8f2c-bf00c27f6663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:37:07.774893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 589/1175] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:37:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:37:07.799784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af4522-df69-4f34-b70f-bbaa9b8dd7c5 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:07.896111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af4522-df69-4f34-b70f-bbaa9b8dd7c5 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:07.927798 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa801872-b224-442b-a07b-c756e6b79ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:07.928656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa801872-b224-442b-a07b-c756e6b79ff8 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:07.928940 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa801872-b224-442b-a07b-c756e6b79ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:07.929216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa801872-b224-442b-a07b-c756e6b79ff8 None admin] PATH_INFO: `/v3/domains/7830ddd4b8d64792b42b9de225ffc65f` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:07.931045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa801872-b224-442b-a07b-c756e6b79ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7830ddd4b8d64792b42b9de225ffc65f)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:07.932507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa801872-b224-442b-a07b-c756e6b79ff8 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:07.934119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 587/1176] 10.222.0.72 () {56 vars in 1183 bytes} [Mon May 16 18:37:07 2022] GET /identity/v3/domains/7830ddd4b8d64792b42b9de225ffc65f => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:37:07.939867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177805d-500b-486b-8f2c-bf00c27f6663 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:08.035579 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177805d-500b-486b-8f2c-bf00c27f6663 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:08.068541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6648bdf-823e-453b-ab39-5dcd56735c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:08.069210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6648bdf-823e-453b-ab39-5dcd56735c53 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:08.069492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6648bdf-823e-453b-ab39-5dcd56735c53 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:08.069767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6648bdf-823e-453b-ab39-5dcd56735c53 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:08.071481 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6648bdf-823e-453b-ab39-5dcd56735c53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:08.072947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6648bdf-823e-453b-ab39-5dcd56735c53 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:08.093759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 590/1177] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:37:07 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:37:10.333432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763e3c0-394e-40eb-a2ed-2231f8ff6c31 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:10.333959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763e3c0-394e-40eb-a2ed-2231f8ff6c31 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:10.333959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763e3c0-394e-40eb-a2ed-2231f8ff6c31 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:10.335268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 588/1178] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:37:10.341397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc569-c301-43e9-860c-fcad8f9a952f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:10.341818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc569-c301-43e9-860c-fcad8f9a952f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:10.341939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc569-c301-43e9-860c-fcad8f9a952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:10.358411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-fb0dc569-c301-43e9-860c-fcad8f9a952f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:37:10.359559 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-fb0dc569-c301-43e9-860c-fcad8f9a952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:37:10.422267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 591/1179] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:37:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:37:10.445659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763e3c0-394e-40eb-a2ed-2231f8ff6c31 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:10.543784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763e3c0-394e-40eb-a2ed-2231f8ff6c31 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:10.575811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8c74a-380f-41c7-b31c-e603befd4031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:10.576589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8c74a-380f-41c7-b31c-e603befd4031 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:10.576869 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8c74a-380f-41c7-b31c-e603befd4031 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:10.577141 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8c74a-380f-41c7-b31c-e603befd4031 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:10.586800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8c74a-380f-41c7-b31c-e603befd4031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-dba8c74a-380f-41c7-b31c-e603befd4031 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:37:10.594565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:37:10.595669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:37:10.596985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 589/1180] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:37:10.601791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dc569-c301-43e9-860c-fcad8f9a952f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:10.694046 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dc569-c301-43e9-860c-fcad8f9a952f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:10.726898 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b004f7-e497-4869-8e77-dd22e8941e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:10.727560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b004f7-e497-4869-8e77-dd22e8941e4b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:10.727875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b004f7-e497-4869-8e77-dd22e8941e4b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:10.728158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b004f7-e497-4869-8e77-dd22e8941e4b None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:10.728903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b004f7-e497-4869-8e77-dd22e8941e4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:37:10.729209 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b004f7-e497-4869-8e77-dd22e8941e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:10.730570 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b004f7-e497-4869-8e77-dd22e8941e4b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:10.738650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 592/1181] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:37:10.745337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8c74a-380f-41c7-b31c-e603befd4031 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:10.841553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8c74a-380f-41c7-b31c-e603befd4031 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:10.874295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0343dd3-6010-4982-a358-10c9150d7666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:10.875151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0343dd3-6010-4982-a358-10c9150d7666 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:10.875432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0343dd3-6010-4982-a358-10c9150d7666 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:10.875739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0343dd3-6010-4982-a358-10c9150d7666 None admin] PATH_INFO: `/v3/users/34051839b55d4261946b9b7f026c368e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:10.887922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0343dd3-6010-4982-a358-10c9150d7666 None admin] RBAC: Authorizing `identity:get_user(user_id=34051839b55d4261946b9b7f026c368e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:10.889350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0343dd3-6010-4982-a358-10c9150d7666 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:10.890965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 590/1182] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:37:10 2022] GET /identity/v3/users/34051839b55d4261946b9b7f026c368e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:37:10.896753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b004f7-e497-4869-8e77-dd22e8941e4b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:10.991695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b004f7-e497-4869-8e77-dd22e8941e4b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:11.024839 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cf8f4-73bf-41d6-8639-d416b3143a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:11.025474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf8f4-73bf-41d6-8639-d416b3143a14 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:11.025752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf8f4-73bf-41d6-8639-d416b3143a14 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:11.026021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf8f4-73bf-41d6-8639-d416b3143a14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:11.088003 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cf8f4-73bf-41d6-8639-d416b3143a14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:11.089429 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cf8f4-73bf-41d6-8639-d416b3143a14 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:11.180924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 593/1183] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:37:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:37:11.186743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0343dd3-6010-4982-a358-10c9150d7666 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:11.279091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0343dd3-6010-4982-a358-10c9150d7666 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:11.310874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873d6b7-165a-45fb-8c7b-21b86ae42d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:11.311743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873d6b7-165a-45fb-8c7b-21b86ae42d3d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:11.312039 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873d6b7-165a-45fb-8c7b-21b86ae42d3d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:11.312312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873d6b7-165a-45fb-8c7b-21b86ae42d3d None admin] PATH_INFO: `/v3/projects/9ca59f3335754ab2a7044e6f6e18fc88` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:11.313475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873d6b7-165a-45fb-8c7b-21b86ae42d3d None admin] RBAC: Authorizing `identity:get_project(project_id=9ca59f3335754ab2a7044e6f6e18fc88)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:11.314885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873d6b7-165a-45fb-8c7b-21b86ae42d3d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:11.316579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 591/1184] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:37:11 2022] GET /identity/v3/projects/9ca59f3335754ab2a7044e6f6e18fc88 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:37:11.322596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cf8f4-73bf-41d6-8639-d416b3143a14 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:11.416148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cf8f4-73bf-41d6-8639-d416b3143a14 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:11.447503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac01afe-dffd-45d2-b2c1-8af0a8babfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:11.448113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01afe-dffd-45d2-b2c1-8af0a8babfe3 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:11.448392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01afe-dffd-45d2-b2c1-8af0a8babfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:11.448665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01afe-dffd-45d2-b2c1-8af0a8babfe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:11.449482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac01afe-dffd-45d2-b2c1-8af0a8babfe3 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=9ca59f3335754ab2a7044e6f6e18fc88, user.id=34051839b55d4261946b9b7f026c368e) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:37:11.449786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac01afe-dffd-45d2-b2c1-8af0a8babfe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:11.451191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac01afe-dffd-45d2-b2c1-8af0a8babfe3 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:11.456352 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 594/1185] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:37:11 2022] GET /identity/v3/role_assignments?user.id=34051839b55d4261946b9b7f026c368e&scope.project.id=9ca59f3335754ab2a7044e6f6e18fc88&role.id=b104fd2e772843a0974990f965d8b589 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:37:13.680233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449511-1c94-4e05-acd4-f5b03b0e97b6 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:13.680802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449511-1c94-4e05-acd4-f5b03b0e97b6 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:13.680802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449511-1c94-4e05-acd4-f5b03b0e97b6 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:13.682155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 592/1186] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:37:13.687239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b309f1-4032-4f24-b04f-7ef4fca58953 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:13.687653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b309f1-4032-4f24-b04f-7ef4fca58953 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:13.687851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b309f1-4032-4f24-b04f-7ef4fca58953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:13.704562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-08b309f1-4032-4f24-b04f-7ef4fca58953 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:37:13.705731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-08b309f1-4032-4f24-b04f-7ef4fca58953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:37:13.768157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 595/1187] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:37:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:37:13.791316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449511-1c94-4e05-acd4-f5b03b0e97b6 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:13.887665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449511-1c94-4e05-acd4-f5b03b0e97b6 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:13.919734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f108ff-6b51-442f-821e-1ad1f111d3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:13.920526 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f108ff-6b51-442f-821e-1ad1f111d3cc None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:13.920810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f108ff-6b51-442f-821e-1ad1f111d3cc None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:13.921087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f108ff-6b51-442f-821e-1ad1f111d3cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:13.932182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f108ff-6b51-442f-821e-1ad1f111d3cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-21f108ff-6b51-442f-821e-1ad1f111d3cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:37:13.939844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:37:13.940950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:37:13.942006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 593/1188] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:37:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:37:13.947386 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b309f1-4032-4f24-b04f-7ef4fca58953 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:14.040961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b309f1-4032-4f24-b04f-7ef4fca58953 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:14.072958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047beeb-df1e-403c-a5f1-1fab9d13a187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:14.073646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047beeb-df1e-403c-a5f1-1fab9d13a187 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:14.073927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047beeb-df1e-403c-a5f1-1fab9d13a187 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:14.074205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047beeb-df1e-403c-a5f1-1fab9d13a187 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:14.074949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047beeb-df1e-403c-a5f1-1fab9d13a187 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:37:14.075254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047beeb-df1e-403c-a5f1-1fab9d13a187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:14.076630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047beeb-df1e-403c-a5f1-1fab9d13a187 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:14.084256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 596/1189] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:37:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:37:14.090555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f108ff-6b51-442f-821e-1ad1f111d3cc None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:14.188226 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f108ff-6b51-442f-821e-1ad1f111d3cc None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:14.220736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43ae65-c1ff-4c7d-8e36-446853e1e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:14.221599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ae65-c1ff-4c7d-8e36-446853e1e17b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:14.221882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ae65-c1ff-4c7d-8e36-446853e1e17b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:14.222157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ae65-c1ff-4c7d-8e36-446853e1e17b None admin] PATH_INFO: `/v3/users/34051839b55d4261946b9b7f026c368e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:14.223347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43ae65-c1ff-4c7d-8e36-446853e1e17b None admin] RBAC: Authorizing `identity:get_user(user_id=34051839b55d4261946b9b7f026c368e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:14.224810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43ae65-c1ff-4c7d-8e36-446853e1e17b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:14.226488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 594/1190] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:37:14 2022] GET /identity/v3/users/34051839b55d4261946b9b7f026c368e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:37:14.232914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047beeb-df1e-403c-a5f1-1fab9d13a187 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:14.326201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047beeb-df1e-403c-a5f1-1fab9d13a187 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:14.358318 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6df5f-cdc9-4055-8b1b-a309efe7202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:14.359163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6df5f-cdc9-4055-8b1b-a309efe7202f None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:14.359437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6df5f-cdc9-4055-8b1b-a309efe7202f None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:14.359732 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6df5f-cdc9-4055-8b1b-a309efe7202f None admin] PATH_INFO: `/v3/projects/9ca59f3335754ab2a7044e6f6e18fc88` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:14.360899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6df5f-cdc9-4055-8b1b-a309efe7202f None admin] RBAC: Authorizing `identity:get_project(project_id=9ca59f3335754ab2a7044e6f6e18fc88)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:14.362319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6df5f-cdc9-4055-8b1b-a309efe7202f None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:14.364002 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 597/1191] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:37:14 2022] GET /identity/v3/projects/9ca59f3335754ab2a7044e6f6e18fc88 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:37:14.370132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43ae65-c1ff-4c7d-8e36-446853e1e17b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:14.466731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43ae65-c1ff-4c7d-8e36-446853e1e17b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:14.499009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215e509-86a4-4ee8-be57-2573b4c08f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:14.499942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215e509-86a4-4ee8-be57-2573b4c08f43 None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:14.500210 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215e509-86a4-4ee8-be57-2573b4c08f43 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:14.500486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215e509-86a4-4ee8-be57-2573b4c08f43 None admin] PATH_INFO: `/v3/projects/9ca59f3335754ab2a7044e6f6e18fc88/users/34051839b55d4261946b9b7f026c368e/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:14.502389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215e509-86a4-4ee8-be57-2573b4c08f43 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ca59f3335754ab2a7044e6f6e18fc88, user_id=34051839b55d4261946b9b7f026c368e, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:14.503867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215e509-86a4-4ee8-be57-2573b4c08f43 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:14.516549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 595/1192] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:37:14 2022] PUT /identity/v3/projects/9ca59f3335754ab2a7044e6f6e18fc88/users/34051839b55d4261946b9b7f026c368e/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:37:16.694899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30214e8-ec15-4366-a6ff-54252071706c None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:16.695469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30214e8-ec15-4366-a6ff-54252071706c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:16.695613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30214e8-ec15-4366-a6ff-54252071706c None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:16.697008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 598/1193] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:37:16.702472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0fab2-8a21-40d8-92b5-c33ef3f5e3fe None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:16.702905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0fab2-8a21-40d8-92b5-c33ef3f5e3fe None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:16.703012 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0fab2-8a21-40d8-92b5-c33ef3f5e3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:16.719786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-99a0fab2-8a21-40d8-92b5-c33ef3f5e3fe None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:37:16.720945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-99a0fab2-8a21-40d8-92b5-c33ef3f5e3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:37:16.782347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 596/1194] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:37:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:37:16.805201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30214e8-ec15-4366-a6ff-54252071706c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:16.902291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30214e8-ec15-4366-a6ff-54252071706c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:16.934033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87f750-5532-4980-ab44-6ca470895ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:16.934821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87f750-5532-4980-ab44-6ca470895ff3 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:16.935100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87f750-5532-4980-ab44-6ca470895ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:16.935373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87f750-5532-4980-ab44-6ca470895ff3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:16.945733 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87f750-5532-4980-ab44-6ca470895ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-0e87f750-5532-4980-ab44-6ca470895ff3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:37:16.953313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:37:16.954501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:37:16.955702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 599/1195] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:37:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:37:16.960470 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0fab2-8a21-40d8-92b5-c33ef3f5e3fe None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:17.051987 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0fab2-8a21-40d8-92b5-c33ef3f5e3fe None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:17.083235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573ebb4-3246-4d20-84fd-fc70cd66be00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:17.083917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ebb4-3246-4d20-84fd-fc70cd66be00 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:17.084197 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ebb4-3246-4d20-84fd-fc70cd66be00 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:17.084471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ebb4-3246-4d20-84fd-fc70cd66be00 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:17.085206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573ebb4-3246-4d20-84fd-fc70cd66be00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:37:17.085509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573ebb4-3246-4d20-84fd-fc70cd66be00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:17.087037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573ebb4-3246-4d20-84fd-fc70cd66be00 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:17.094796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 597/1196] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:37:17.100424 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87f750-5532-4980-ab44-6ca470895ff3 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:17.194634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87f750-5532-4980-ab44-6ca470895ff3 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:17.226433 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e2739-55a3-4263-ae89-e7e056e25644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:17.227232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e2739-55a3-4263-ae89-e7e056e25644 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:17.227512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e2739-55a3-4263-ae89-e7e056e25644 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:17.227812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e2739-55a3-4263-ae89-e7e056e25644 None admin] PATH_INFO: `/v3/users/34051839b55d4261946b9b7f026c368e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:17.228979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e2739-55a3-4263-ae89-e7e056e25644 None admin] RBAC: Authorizing `identity:get_user(user_id=34051839b55d4261946b9b7f026c368e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:17.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e2739-55a3-4263-ae89-e7e056e25644 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:17.232025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 600/1197] 10.222.0.72 () {56 vars in 1177 bytes} [Mon May 16 18:37:17 2022] GET /identity/v3/users/34051839b55d4261946b9b7f026c368e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:37:17.237643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573ebb4-3246-4d20-84fd-fc70cd66be00 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:17.331539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573ebb4-3246-4d20-84fd-fc70cd66be00 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:17.362420 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4529f0-cd60-4782-9a9c-645b2da57b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:17.363053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4529f0-cd60-4782-9a9c-645b2da57b5b None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:17.363335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4529f0-cd60-4782-9a9c-645b2da57b5b None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:17.363611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4529f0-cd60-4782-9a9c-645b2da57b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:17.427574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4529f0-cd60-4782-9a9c-645b2da57b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:17.429040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4529f0-cd60-4782-9a9c-645b2da57b5b None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:17.520139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 598/1198] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:37:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:37:17.526072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e2739-55a3-4263-ae89-e7e056e25644 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:17.624877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e2739-55a3-4263-ae89-e7e056e25644 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:17.655833 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749e1df-d462-4143-bfc0-fd7d22b346e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:17.656688 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e1df-d462-4143-bfc0-fd7d22b346e7 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:17.656969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e1df-d462-4143-bfc0-fd7d22b346e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:17.657242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e1df-d462-4143-bfc0-fd7d22b346e7 None admin] PATH_INFO: `/v3/projects/9ca59f3335754ab2a7044e6f6e18fc88` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:17.658404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749e1df-d462-4143-bfc0-fd7d22b346e7 None admin] RBAC: Authorizing `identity:get_project(project_id=9ca59f3335754ab2a7044e6f6e18fc88)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:17.659849 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749e1df-d462-4143-bfc0-fd7d22b346e7 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:17.661589 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 601/1199] 10.222.0.72 () {56 vars in 1186 bytes} [Mon May 16 18:37:17 2022] GET /identity/v3/projects/9ca59f3335754ab2a7044e6f6e18fc88 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:37:17.668344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4529f0-cd60-4782-9a9c-645b2da57b5b None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:37:17.761560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4529f0-cd60-4782-9a9c-645b2da57b5b None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:37:17.793140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9f5bd-88d1-4e04-a208-787c0158fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:37:17.793722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f5bd-88d1-4e04-a208-787c0158fe33 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:37:17.794006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f5bd-88d1-4e04-a208-787c0158fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:37:17.794279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f5bd-88d1-4e04-a208-787c0158fe33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:37:17.795100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9f5bd-88d1-4e04-a208-787c0158fe33 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=9ca59f3335754ab2a7044e6f6e18fc88, user.id=34051839b55d4261946b9b7f026c368e) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:37:17.795409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9f5bd-88d1-4e04-a208-787c0158fe33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:37:17.796853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9f5bd-88d1-4e04-a208-787c0158fe33 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:37:17.802532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 599/1200] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:37:17 2022] GET /identity/v3/role_assignments?user.id=34051839b55d4261946b9b7f026c368e&scope.project.id=9ca59f3335754ab2a7044e6f6e18fc88&role.id=b104fd2e772843a0974990f965d8b589 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:18.550971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87f9e8-5fad-4c21-99d0-eae3e9878268 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:18.551584 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87f9e8-5fad-4c21-99d0-eae3e9878268 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:18.551584 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87f9e8-5fad-4c21-99d0-eae3e9878268 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:18.554625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 602/1201] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:38:18.562113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e7bcc-927e-45a0-a37a-016900e365ce None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:18.562621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e7bcc-927e-45a0-a37a-016900e365ce None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:18.562819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e7bcc-927e-45a0-a37a-016900e365ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:18.584470 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-de8e7bcc-927e-45a0-a37a-016900e365ce None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:38:18.585763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-de8e7bcc-927e-45a0-a37a-016900e365ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:38:18.666953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 600/1202] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:38:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:38:18.694727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87f9e8-5fad-4c21-99d0-eae3e9878268 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:18.833663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87f9e8-5fad-4c21-99d0-eae3e9878268 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:18.872901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a02aa-1f88-4d51-959a-604969235fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:18.873911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a02aa-1f88-4d51-959a-604969235fe2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:18.874188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a02aa-1f88-4d51-959a-604969235fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:18.874535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a02aa-1f88-4d51-959a-604969235fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:18.887826 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a02aa-1f88-4d51-959a-604969235fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:18.889481 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a02aa-1f88-4d51-959a-604969235fe2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-dd3a02aa-1f88-4d51-959a-604969235fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:18.909894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:18.910916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:18.912004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:18.912004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:18.912004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:18.912004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:18.914205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 603/1203] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:18.921009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e7bcc-927e-45a0-a37a-016900e365ce None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:19.043404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e7bcc-927e-45a0-a37a-016900e365ce None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:19.089647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3785bf-5a81-44e4-83fa-2d96f0c6a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:19.090352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3785bf-5a81-44e4-83fa-2d96f0c6a1fe None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:19.090648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3785bf-5a81-44e4-83fa-2d96f0c6a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:19.090922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3785bf-5a81-44e4-83fa-2d96f0c6a1fe None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:19.091736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3785bf-5a81-44e4-83fa-2d96f0c6a1fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:19.092399 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3785bf-5a81-44e4-83fa-2d96f0c6a1fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:19.093791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3785bf-5a81-44e4-83fa-2d96f0c6a1fe None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:19.106877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 601/1204] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:38:19.112714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a02aa-1f88-4d51-959a-604969235fe2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:19.245601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a02aa-1f88-4d51-959a-604969235fe2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:19.303946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d3e48-ee38-43b1-9a86-235e73b87228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:19.304630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d3e48-ee38-43b1-9a86-235e73b87228 None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:19.304896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d3e48-ee38-43b1-9a86-235e73b87228 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:19.305183 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d3e48-ee38-43b1-9a86-235e73b87228 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:19.305949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d3e48-ee38-43b1-9a86-235e73b87228 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:19.308666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d3e48-ee38-43b1-9a86-235e73b87228 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:19.340199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 604/1205] 10.222.0.72 () {60 vars in 1132 bytes} [Mon May 16 18:38:19 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:38:21.905875 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e395d-17c8-44ef-932a-bf7bd8ff53f9 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:21.906436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e395d-17c8-44ef-932a-bf7bd8ff53f9 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:21.906569 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e395d-17c8-44ef-932a-bf7bd8ff53f9 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:21.908510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 602/1206] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:38:21.916386 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cbd1d-931b-49af-9682-7575ef8bc86c None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:21.916885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cbd1d-931b-49af-9682-7575ef8bc86c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:21.916966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cbd1d-931b-49af-9682-7575ef8bc86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:21.937291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-ae8cbd1d-931b-49af-9682-7575ef8bc86c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:38:21.938724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ae8cbd1d-931b-49af-9682-7575ef8bc86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:38:22.016959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 605/1207] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:38:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:38:22.043178 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e395d-17c8-44ef-932a-bf7bd8ff53f9 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:22.165885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e395d-17c8-44ef-932a-bf7bd8ff53f9 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:22.205230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2619ba-4758-4818-a2a0-4607d206c464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:22.206127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2619ba-4758-4818-a2a0-4607d206c464 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:22.206409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2619ba-4758-4818-a2a0-4607d206c464 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:22.206684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2619ba-4758-4818-a2a0-4607d206c464 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:22.218452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2619ba-4758-4818-a2a0-4607d206c464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-bd2619ba-4758-4818-a2a0-4607d206c464 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:38:22.227666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:22.228788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:22.229733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 603/1208] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:38:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:22.235391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cbd1d-931b-49af-9682-7575ef8bc86c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:22.351187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cbd1d-931b-49af-9682-7575ef8bc86c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:22.392997 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d912e8-4f8b-45db-af85-cfc20f12cb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:22.393671 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d912e8-4f8b-45db-af85-cfc20f12cb55 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:22.394004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d912e8-4f8b-45db-af85-cfc20f12cb55 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:22.394301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d912e8-4f8b-45db-af85-cfc20f12cb55 None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:22.397805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d912e8-4f8b-45db-af85-cfc20f12cb55 None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:22.397805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d912e8-4f8b-45db-af85-cfc20f12cb55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:22.397805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d912e8-4f8b-45db-af85-cfc20f12cb55 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:22.408026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 606/1209] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:38:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:22.413776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2619ba-4758-4818-a2a0-4607d206c464 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:22.527573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2619ba-4758-4818-a2a0-4607d206c464 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:22.565121 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc155c-638a-4ed2-b0da-23291f1faecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:22.565993 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc155c-638a-4ed2-b0da-23291f1faecc None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:22.566327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc155c-638a-4ed2-b0da-23291f1faecc None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:22.566630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc155c-638a-4ed2-b0da-23291f1faecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:22.580073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc155c-638a-4ed2-b0da-23291f1faecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:22.580423 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc155c-638a-4ed2-b0da-23291f1faecc None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-d2dc155c-638a-4ed2-b0da-23291f1faecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:22.600011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:22.601082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:22.601986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:22.601986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:22.601986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:22.601986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:22.601986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 604/1210] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:22.608680 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d912e8-4f8b-45db-af85-cfc20f12cb55 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:22.724430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d912e8-4f8b-45db-af85-cfc20f12cb55 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:22.764949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a2131-2518-420b-b3a2-f9bf74a1f397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:22.765618 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a2131-2518-420b-b3a2-f9bf74a1f397 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:22.765891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a2131-2518-420b-b3a2-f9bf74a1f397 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:22.766162 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a2131-2518-420b-b3a2-f9bf74a1f397 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:22.766894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a2131-2518-420b-b3a2-f9bf74a1f397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:22.767196 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a2131-2518-420b-b3a2-f9bf74a1f397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:22.768581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a2131-2518-420b-b3a2-f9bf74a1f397 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:22.783496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 607/1211] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:22.790062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc155c-638a-4ed2-b0da-23291f1faecc None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:22.899624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc155c-638a-4ed2-b0da-23291f1faecc None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:22.937918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a3ec5-3586-4b57-b2a7-581578c3638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:22.938758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a3ec5-3586-4b57-b2a7-581578c3638c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:22.939112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a3ec5-3586-4b57-b2a7-581578c3638c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:22.939490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a3ec5-3586-4b57-b2a7-581578c3638c None admin] PATH_INFO: `/v3/users/placement` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:22.951282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a3ec5-3586-4b57-b2a7-581578c3638c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:22.952792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a3ec5-3586-4b57-b2a7-581578c3638c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-b22a3ec5-3586-4b57-b2a7-581578c3638c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:38:22.972793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:22.974401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:22.975349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:22.975349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:22.975349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:38:22.975349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:38:22.975349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:38:22.975349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:38:22.975349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:38:22.975349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:38:22.975349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:22.975349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:22.975349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 605/1212] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:38:22.979885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a2131-2518-420b-b3a2-f9bf74a1f397 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:23.096215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a2131-2518-420b-b3a2-f9bf74a1f397 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:23.133673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667bc63-08cc-43bb-8513-8a515f2d5a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:23.134346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667bc63-08cc-43bb-8513-8a515f2d5a37 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:23.134626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667bc63-08cc-43bb-8513-8a515f2d5a37 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:23.134899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667bc63-08cc-43bb-8513-8a515f2d5a37 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:23.135816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667bc63-08cc-43bb-8513-8a515f2d5a37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:23.136145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667bc63-08cc-43bb-8513-8a515f2d5a37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:23.137761 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667bc63-08cc-43bb-8513-8a515f2d5a37 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:23.156762 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 608/1213] 10.222.0.72 () {56 vars in 1143 bytes} [Mon May 16 18:38:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:23.163054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a3ec5-3586-4b57-b2a7-581578c3638c None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:23.271722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a3ec5-3586-4b57-b2a7-581578c3638c None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:23.308277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b052-f7fd-4259-bcec-8e2d77cddcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:23.308983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b052-f7fd-4259-bcec-8e2d77cddcd4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:23.309312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b052-f7fd-4259-bcec-8e2d77cddcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:23.309645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7b052-f7fd-4259-bcec-8e2d77cddcd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:23.388171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7b052-f7fd-4259-bcec-8e2d77cddcd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:23.389791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7b052-f7fd-4259-bcec-8e2d77cddcd4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:23.500789 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 606/1214] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:38:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:38:23.507941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667bc63-08cc-43bb-8513-8a515f2d5a37 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:23.623076 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667bc63-08cc-43bb-8513-8a515f2d5a37 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:23.657938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af83b4-11c9-4045-a8fe-7567a04a2d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:23.658753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af83b4-11c9-4045-a8fe-7567a04a2d02 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:23.659037 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af83b4-11c9-4045-a8fe-7567a04a2d02 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:23.659328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af83b4-11c9-4045-a8fe-7567a04a2d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:23.670758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af83b4-11c9-4045-a8fe-7567a04a2d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:23.672287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af83b4-11c9-4045-a8fe-7567a04a2d02 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-c9af83b4-11c9-4045-a8fe-7567a04a2d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:23.692119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:23.693219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:23.694297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:23.694297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:23.694297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:23.694297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:23.694297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 609/1215] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:38:23.699414 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b052-f7fd-4259-bcec-8e2d77cddcd4 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:23.817050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7b052-f7fd-4259-bcec-8e2d77cddcd4 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:23.854630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fdbf6-244a-450e-91fe-b43b0c79f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:23.856065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fdbf6-244a-450e-91fe-b43b0c79f896 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:23.856231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fdbf6-244a-450e-91fe-b43b0c79f896 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:23.856617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fdbf6-244a-450e-91fe-b43b0c79f896 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:23.857441 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fdbf6-244a-450e-91fe-b43b0c79f896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:23.857854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fdbf6-244a-450e-91fe-b43b0c79f896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:23.859304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fdbf6-244a-450e-91fe-b43b0c79f896 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:23.871359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 607/1216] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:23.877128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af83b4-11c9-4045-a8fe-7567a04a2d02 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:23.993542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af83b4-11c9-4045-a8fe-7567a04a2d02 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:24.033474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfed0b-be39-400a-aa27-31a1917767a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:24.034583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfed0b-be39-400a-aa27-31a1917767a8 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:24.035006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfed0b-be39-400a-aa27-31a1917767a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:24.035451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfed0b-be39-400a-aa27-31a1917767a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:24.043560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfed0b-be39-400a-aa27-31a1917767a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:24.045290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfed0b-be39-400a-aa27-31a1917767a8 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-e7dfed0b-be39-400a-aa27-31a1917767a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:38:24.060836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:24.061891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:24.068387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:38:24.068387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:38:24.068387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:38:24.068387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:38:24.068387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:38:24.068387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:38:24.068387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:24.068387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:24.068387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 610/1217] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:24.069037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fdbf6-244a-450e-91fe-b43b0c79f896 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:24.175879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fdbf6-244a-450e-91fe-b43b0c79f896 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:24.210265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50810f10-3759-47c5-92e3-cc16d4d5f394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:24.210849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810f10-3759-47c5-92e3-cc16d4d5f394 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:24.211131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810f10-3759-47c5-92e3-cc16d4d5f394 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:24.211427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810f10-3759-47c5-92e3-cc16d4d5f394 None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:24.212287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50810f10-3759-47c5-92e3-cc16d4d5f394 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:24.212646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50810f10-3759-47c5-92e3-cc16d4d5f394 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:24.214024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50810f10-3759-47c5-92e3-cc16d4d5f394 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:24.227292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 608/1218] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:38:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:24.233299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfed0b-be39-400a-aa27-31a1917767a8 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:24.341228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfed0b-be39-400a-aa27-31a1917767a8 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:24.378772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3c3ce-3058-4ed7-801e-da27870ed449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:24.379535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3c3ce-3058-4ed7-801e-da27870ed449 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:24.379923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3c3ce-3058-4ed7-801e-da27870ed449 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:24.380763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3c3ce-3058-4ed7-801e-da27870ed449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:24.381659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3c3ce-3058-4ed7-801e-da27870ed449 None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=443fd569cd1b4f6db86d575ed669e26a) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:24.382044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3c3ce-3058-4ed7-801e-da27870ed449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:24.383532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3c3ce-3058-4ed7-801e-da27870ed449 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:24.389262 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 611/1219] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:38:24 2022] GET /identity/v3/role_assignments?user.id=443fd569cd1b4f6db86d575ed669e26a&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:26.644475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2120d-bf85-477e-a0ee-9f692622ba9d None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:26.645065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2120d-bf85-477e-a0ee-9f692622ba9d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:26.645065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2120d-bf85-477e-a0ee-9f692622ba9d None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:26.647064 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 609/1220] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:38:26.653618 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e90494-df07-480c-ad04-cf3733864089 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:26.654198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e90494-df07-480c-ad04-cf3733864089 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:26.654338 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e90494-df07-480c-ad04-cf3733864089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:26.672631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-64e90494-df07-480c-ad04-cf3733864089 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:38:26.673902 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-64e90494-df07-480c-ad04-cf3733864089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:38:26.746564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 612/1221] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:38:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:38:26.771887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2120d-bf85-477e-a0ee-9f692622ba9d None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:26.879462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2120d-bf85-477e-a0ee-9f692622ba9d None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:26.919657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ffa12-4eff-44f8-b5b0-48f448be3849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:26.920730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ffa12-4eff-44f8-b5b0-48f448be3849 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:26.921144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ffa12-4eff-44f8-b5b0-48f448be3849 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:26.921686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ffa12-4eff-44f8-b5b0-48f448be3849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:26.937352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ffa12-4eff-44f8-b5b0-48f448be3849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-df1ffa12-4eff-44f8-b5b0-48f448be3849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:38:26.947625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:26.948702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:26.949539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 610/1222] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:38:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:26.955638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e90494-df07-480c-ad04-cf3733864089 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:27.069493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e90494-df07-480c-ad04-cf3733864089 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:27.105690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa1708-8f51-4f11-bdc0-50d334f3d46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:27.106362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa1708-8f51-4f11-bdc0-50d334f3d46d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:27.106641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa1708-8f51-4f11-bdc0-50d334f3d46d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:27.106913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa1708-8f51-4f11-bdc0-50d334f3d46d None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:27.107655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa1708-8f51-4f11-bdc0-50d334f3d46d None admin] RBAC: Adding query filter params (name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:27.107991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa1708-8f51-4f11-bdc0-50d334f3d46d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:27.109372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa1708-8f51-4f11-bdc0-50d334f3d46d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:27.117626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 613/1223] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:38:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:27.123418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ffa12-4eff-44f8-b5b0-48f448be3849 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:27.227224 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ffa12-4eff-44f8-b5b0-48f448be3849 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:27.263391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283ed82-b241-4488-ba52-266449416200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:27.264211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283ed82-b241-4488-ba52-266449416200 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:27.264492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283ed82-b241-4488-ba52-266449416200 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:27.264766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283ed82-b241-4488-ba52-266449416200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:27.275536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283ed82-b241-4488-ba52-266449416200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:27.277014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283ed82-b241-4488-ba52-266449416200 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-7283ed82-b241-4488-ba52-266449416200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:27.294261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:27.295409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:27.296487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:27.296487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:27.296487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:27.296487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:27.296487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 611/1224] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:27.301716 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa1708-8f51-4f11-bdc0-50d334f3d46d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:27.412751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa1708-8f51-4f11-bdc0-50d334f3d46d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:27.445631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cda22-0cf3-4590-a8ab-536eac2d0960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:27.446295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cda22-0cf3-4590-a8ab-536eac2d0960 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:27.446575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cda22-0cf3-4590-a8ab-536eac2d0960 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:27.446850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cda22-0cf3-4590-a8ab-536eac2d0960 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:27.447568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cda22-0cf3-4590-a8ab-536eac2d0960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:27.448072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cda22-0cf3-4590-a8ab-536eac2d0960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:27.449765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cda22-0cf3-4590-a8ab-536eac2d0960 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:27.462042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 614/1225] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:27.467916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283ed82-b241-4488-ba52-266449416200 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:27.573929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283ed82-b241-4488-ba52-266449416200 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:27.612266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d9ae9-5edc-46d0-a554-f9e5b186b066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:27.613193 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9ae9-5edc-46d0-a554-f9e5b186b066 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:27.613578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9ae9-5edc-46d0-a554-f9e5b186b066 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:27.613866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9ae9-5edc-46d0-a554-f9e5b186b066 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:27.621658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d9ae9-5edc-46d0-a554-f9e5b186b066 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:27.623105 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d9ae9-5edc-46d0-a554-f9e5b186b066 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-e34d9ae9-5edc-46d0-a554-f9e5b186b066 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:38:27.639460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:27.640700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:27.642180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:27.642180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:27.642180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:38:27.642180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:38:27.642180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:38:27.642180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:38:27.642180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:38:27.642180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:38:27.642180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:27.642180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:27.642180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 612/1226] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:27.647438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cda22-0cf3-4590-a8ab-536eac2d0960 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:27.766678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cda22-0cf3-4590-a8ab-536eac2d0960 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:27.810121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddb9b6-f487-4469-a5d9-01b6310788ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:27.810866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb9b6-f487-4469-a5d9-01b6310788ed None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:27.811212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb9b6-f487-4469-a5d9-01b6310788ed None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:27.811527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb9b6-f487-4469-a5d9-01b6310788ed None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:27.812407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddb9b6-f487-4469-a5d9-01b6310788ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:27.812728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddb9b6-f487-4469-a5d9-01b6310788ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:27.814252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddb9b6-f487-4469-a5d9-01b6310788ed None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:27.834714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 615/1227] 10.222.0.72 () {56 vars in 1143 bytes} [Mon May 16 18:38:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:27.840697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d9ae9-5edc-46d0-a554-f9e5b186b066 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:27.950732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d9ae9-5edc-46d0-a554-f9e5b186b066 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:27.988010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc444e-a2f3-49be-b89e-6db38324a3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:27.988807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc444e-a2f3-49be-b89e-6db38324a3d4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:27.991061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc444e-a2f3-49be-b89e-6db38324a3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:27.991339 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc444e-a2f3-49be-b89e-6db38324a3d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:28.002385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc444e-a2f3-49be-b89e-6db38324a3d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:28.004007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc444e-a2f3-49be-b89e-6db38324a3d4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-94cc444e-a2f3-49be-b89e-6db38324a3d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:28.022500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:28.023637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:28.024771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:28.024771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:28.024771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:28.024771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:28.028732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 613/1228] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:38:28.029801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddb9b6-f487-4469-a5d9-01b6310788ed None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:28.142189 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddb9b6-f487-4469-a5d9-01b6310788ed None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:28.189694 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8cdf1-4aea-4bff-9d9f-867cae28cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:28.190471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8cdf1-4aea-4bff-9d9f-867cae28cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:28.190812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8cdf1-4aea-4bff-9d9f-867cae28cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:28.191110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8cdf1-4aea-4bff-9d9f-867cae28cbf1 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:28.191986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8cdf1-4aea-4bff-9d9f-867cae28cbf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:28.192934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8cdf1-4aea-4bff-9d9f-867cae28cbf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:28.194646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8cdf1-4aea-4bff-9d9f-867cae28cbf1 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:28.207794 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 616/1229] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:38:28.214549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc444e-a2f3-49be-b89e-6db38324a3d4 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:28.324782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc444e-a2f3-49be-b89e-6db38324a3d4 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:28.367080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b96118-5212-4f8c-b0df-45b6d65ac6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:28.367983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96118-5212-4f8c-b0df-45b6d65ac6d3 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:28.368320 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96118-5212-4f8c-b0df-45b6d65ac6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:28.368602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96118-5212-4f8c-b0df-45b6d65ac6d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:28.376427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b96118-5212-4f8c-b0df-45b6d65ac6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:28.378053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b96118-5212-4f8c-b0df-45b6d65ac6d3 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-75b96118-5212-4f8c-b0df-45b6d65ac6d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:38:28.392649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:28.393699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:28.394745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:38:28.394745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:38:28.394745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:38:28.394745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:38:28.394745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:38:28.394745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:38:28.394745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:28.394745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:28.394745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 614/1230] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:38:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:28.399864 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8cdf1-4aea-4bff-9d9f-867cae28cbf1 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:28.511971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8cdf1-4aea-4bff-9d9f-867cae28cbf1 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:28.545540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58957b-f70b-446f-946e-e1126ee193ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:28.546207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58957b-f70b-446f-946e-e1126ee193ec None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:28.546528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58957b-f70b-446f-946e-e1126ee193ec None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:28.546803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58957b-f70b-446f-946e-e1126ee193ec None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:28.547686 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58957b-f70b-446f-946e-e1126ee193ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:28.548068 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58957b-f70b-446f-946e-e1126ee193ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:28.549646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58957b-f70b-446f-946e-e1126ee193ec None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:28.561972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 617/1231] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:38:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:28.568886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b96118-5212-4f8c-b0df-45b6d65ac6d3 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:28.677891 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b96118-5212-4f8c-b0df-45b6d65ac6d3 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:28.714488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4985f2-88c9-4a88-a803-7fdcf68f86cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:28.716075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4985f2-88c9-4a88-a803-7fdcf68f86cd None admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:28.716362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4985f2-88c9-4a88-a803-7fdcf68f86cd None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:28.716642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4985f2-88c9-4a88-a803-7fdcf68f86cd None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/443fd569cd1b4f6db86d575ed669e26a/roles/07ebf23e49074f6ca9b1f96878f4fa7b` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:28.732623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4985f2-88c9-4a88-a803-7fdcf68f86cd None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=443fd569cd1b4f6db86d575ed669e26a, role_id=07ebf23e49074f6ca9b1f96878f4fa7b)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:28.734111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4985f2-88c9-4a88-a803-7fdcf68f86cd None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:28.746211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 615/1232] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:38:28 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/443fd569cd1b4f6db86d575ed669e26a/roles/07ebf23e49074f6ca9b1f96878f4fa7b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:38:31.166207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d7aaf-7b07-4a08-82e9-415eb751da9a None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:31.166818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d7aaf-7b07-4a08-82e9-415eb751da9a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:31.166818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d7aaf-7b07-4a08-82e9-415eb751da9a None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:31.168266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 618/1233] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:38:31.173775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfc0d-2e1c-4a4c-91ba-67403078934d None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:31.174224 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfc0d-2e1c-4a4c-91ba-67403078934d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:31.174385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfc0d-2e1c-4a4c-91ba-67403078934d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:31.193877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-7dddfc0d-2e1c-4a4c-91ba-67403078934d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:38:31.194990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7dddfc0d-2e1c-4a4c-91ba-67403078934d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:38:31.265011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 616/1234] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:38:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:38:31.290061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d7aaf-7b07-4a08-82e9-415eb751da9a None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:31.398624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d7aaf-7b07-4a08-82e9-415eb751da9a None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:31.435001 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa80528-feaf-441a-839b-eae4e76bc858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:31.436281 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80528-feaf-441a-839b-eae4e76bc858 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:31.436948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80528-feaf-441a-839b-eae4e76bc858 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:31.437974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80528-feaf-441a-839b-eae4e76bc858 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:31.449808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa80528-feaf-441a-839b-eae4e76bc858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-daa80528-feaf-441a-839b-eae4e76bc858 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:38:31.459114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:31.460663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:31.461581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 619/1235] 10.222.0.72 () {56 vars in 1102 bytes} [Mon May 16 18:38:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:31.466677 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddfc0d-2e1c-4a4c-91ba-67403078934d None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:31.572625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddfc0d-2e1c-4a4c-91ba-67403078934d None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:31.610955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a137-cda2-4343-848f-75a8897d6697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:31.611625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a137-cda2-4343-848f-75a8897d6697 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:31.611938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a137-cda2-4343-848f-75a8897d6697 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:31.612211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a137-cda2-4343-848f-75a8897d6697 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:31.612956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9a137-cda2-4343-848f-75a8897d6697 None admin] RBAC: Adding query filter params (name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:31.613259 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9a137-cda2-4343-848f-75a8897d6697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:31.615141 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9a137-cda2-4343-848f-75a8897d6697 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:31.623648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 617/1236] 10.222.0.72 () {56 vars in 1103 bytes} [Mon May 16 18:38:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:38:31.630527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa80528-feaf-441a-839b-eae4e76bc858 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:31.738789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa80528-feaf-441a-839b-eae4e76bc858 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:31.775674 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa746-7c35-44ba-9bb8-ed4cc802e721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:31.776542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa746-7c35-44ba-9bb8-ed4cc802e721 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:31.776909 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa746-7c35-44ba-9bb8-ed4cc802e721 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:31.777163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa746-7c35-44ba-9bb8-ed4cc802e721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:31.788314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaa746-7c35-44ba-9bb8-ed4cc802e721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:31.789774 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaa746-7c35-44ba-9bb8-ed4cc802e721 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-b7aaa746-7c35-44ba-9bb8-ed4cc802e721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:31.807332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:31.808456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:31.809879 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:31.809879 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:31.809879 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:31.809879 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:31.809879 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 620/1237] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:31.814510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a137-cda2-4343-848f-75a8897d6697 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:31.923020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a137-cda2-4343-848f-75a8897d6697 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:31.960312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bed77-f415-45fa-8295-93970947a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:31.961066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bed77-f415-45fa-8295-93970947a81a None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:31.961362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bed77-f415-45fa-8295-93970947a81a None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:31.961713 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bed77-f415-45fa-8295-93970947a81a None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:31.962546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bed77-f415-45fa-8295-93970947a81a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:31.962898 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bed77-f415-45fa-8295-93970947a81a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:31.964488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bed77-f415-45fa-8295-93970947a81a None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:31.979291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 618/1238] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:38:31.985600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa746-7c35-44ba-9bb8-ed4cc802e721 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:32.097052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa746-7c35-44ba-9bb8-ed4cc802e721 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:32.134875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25359c33-6ad4-4683-b034-5183acc6e8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:32.135687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25359c33-6ad4-4683-b034-5183acc6e8b4 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:32.136018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25359c33-6ad4-4683-b034-5183acc6e8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:32.136337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25359c33-6ad4-4683-b034-5183acc6e8b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:32.144580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25359c33-6ad4-4683-b034-5183acc6e8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:32.146066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25359c33-6ad4-4683-b034-5183acc6e8b4 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-25359c33-6ad4-4683-b034-5183acc6e8b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:38:32.160903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:32.162953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:32.164276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:32.164276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:32.164276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:38:32.164276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:38:32.164276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:38:32.164276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:38:32.164276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:38:32.164276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:38:32.164276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:32.164276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:32.164276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 621/1239] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:32.174656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bed77-f415-45fa-8295-93970947a81a None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:32.280205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bed77-f415-45fa-8295-93970947a81a None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:32.319166 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95685c49-c63c-4cdf-96b9-8e96c2b7d8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:32.320201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95685c49-c63c-4cdf-96b9-8e96c2b7d8fe None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:32.320541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95685c49-c63c-4cdf-96b9-8e96c2b7d8fe None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:32.320766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95685c49-c63c-4cdf-96b9-8e96c2b7d8fe None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:32.321617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95685c49-c63c-4cdf-96b9-8e96c2b7d8fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:32.321918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95685c49-c63c-4cdf-96b9-8e96c2b7d8fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:32.323341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95685c49-c63c-4cdf-96b9-8e96c2b7d8fe None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:32.344030 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 619/1240] 10.222.0.72 () {56 vars in 1143 bytes} [Mon May 16 18:38:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:32.350168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25359c33-6ad4-4683-b034-5183acc6e8b4 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:32.458902 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25359c33-6ad4-4683-b034-5183acc6e8b4 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:32.496369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18988989-06d5-4c56-9414-db0e510ba677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:32.497070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18988989-06d5-4c56-9414-db0e510ba677 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:32.497393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18988989-06d5-4c56-9414-db0e510ba677 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:32.497817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18988989-06d5-4c56-9414-db0e510ba677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:32.577293 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18988989-06d5-4c56-9414-db0e510ba677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:32.578886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18988989-06d5-4c56-9414-db0e510ba677 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:32.690185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 622/1241] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:38:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:38:32.691577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95685c49-c63c-4cdf-96b9-8e96c2b7d8fe None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:32.807526 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95685c49-c63c-4cdf-96b9-8e96c2b7d8fe None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:32.846682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0248f5-0c0e-42d6-98f4-295334923f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:32.847593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0248f5-0c0e-42d6-98f4-295334923f5c None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:32.849287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0248f5-0c0e-42d6-98f4-295334923f5c None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:32.849287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0248f5-0c0e-42d6-98f4-295334923f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:32.860326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0248f5-0c0e-42d6-98f4-295334923f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:32.861761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0248f5-0c0e-42d6-98f4-295334923f5c None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-ec0248f5-0c0e-42d6-98f4-295334923f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:32.880440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:32.881582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:32.882692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:32.882692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:32.882692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:32.882692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:32.882692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 620/1242] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:32.887423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18988989-06d5-4c56-9414-db0e510ba677 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:32.987402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18988989-06d5-4c56-9414-db0e510ba677 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:33.023074 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3b1f4-9f24-4410-9b56-4441116037f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:33.023770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3b1f4-9f24-4410-9b56-4441116037f0 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:33.024102 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3b1f4-9f24-4410-9b56-4441116037f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:33.024329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3b1f4-9f24-4410-9b56-4441116037f0 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:33.025169 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3b1f4-9f24-4410-9b56-4441116037f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:33.025475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3b1f4-9f24-4410-9b56-4441116037f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:33.026940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3b1f4-9f24-4410-9b56-4441116037f0 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:33.039938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 623/1243] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:33.046074 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0248f5-0c0e-42d6-98f4-295334923f5c None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:33.155746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0248f5-0c0e-42d6-98f4-295334923f5c None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:33.194066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8fbbc-396d-4638-b160-0fcb5f90d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:33.195026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8fbbc-396d-4638-b160-0fcb5f90d484 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:33.195311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8fbbc-396d-4638-b160-0fcb5f90d484 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:33.195586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8fbbc-396d-4638-b160-0fcb5f90d484 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:33.203126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8fbbc-396d-4638-b160-0fcb5f90d484 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:33.204626 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8fbbc-396d-4638-b160-0fcb5f90d484 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-fce8fbbc-396d-4638-b160-0fcb5f90d484 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:38:33.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:33.222555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:33.223512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:38:33.223512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:38:33.223512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:38:33.223512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:38:33.223512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:38:33.223512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:38:33.223512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:33.223512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:33.223512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 621/1244] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:38:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:38:33.229219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3b1f4-9f24-4410-9b56-4441116037f0 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:33.340467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3b1f4-9f24-4410-9b56-4441116037f0 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:33.381749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff6674-170e-4093-b9cd-3ed9c954e117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:33.382452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6674-170e-4093-b9cd-3ed9c954e117 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:33.382700 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6674-170e-4093-b9cd-3ed9c954e117 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:33.383045 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6674-170e-4093-b9cd-3ed9c954e117 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:33.384052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff6674-170e-4093-b9cd-3ed9c954e117 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:33.384442 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff6674-170e-4093-b9cd-3ed9c954e117 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:33.386116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff6674-170e-4093-b9cd-3ed9c954e117 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:33.400039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 624/1245] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:38:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:33.406793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8fbbc-396d-4638-b160-0fcb5f90d484 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:33.517310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8fbbc-396d-4638-b160-0fcb5f90d484 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:33.555981 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05898-6d5a-4fdd-9a3f-7545f9a51eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:33.557085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05898-6d5a-4fdd-9a3f-7545f9a51eeb None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:33.557568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05898-6d5a-4fdd-9a3f-7545f9a51eeb None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:33.557953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05898-6d5a-4fdd-9a3f-7545f9a51eeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:33.558919 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc05898-6d5a-4fdd-9a3f-7545f9a51eeb None admin] RBAC: Adding query filter params (role.id=07ebf23e49074f6ca9b1f96878f4fa7b, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=443fd569cd1b4f6db86d575ed669e26a) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:33.559239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc05898-6d5a-4fdd-9a3f-7545f9a51eeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:33.560700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc05898-6d5a-4fdd-9a3f-7545f9a51eeb None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:33.566749 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 622/1246] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:38:33 2022] GET /identity/v3/role_assignments?user.id=443fd569cd1b4f6db86d575ed669e26a&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=07ebf23e49074f6ca9b1f96878f4fa7b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:38:36.087197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c1fb-a0ca-484f-98dd-e49b2e625e57 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:36.087917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c1fb-a0ca-484f-98dd-e49b2e625e57 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:36.087917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c1fb-a0ca-484f-98dd-e49b2e625e57 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:36.089213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 625/1247] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:38:36.095252 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe56b09-7b7c-4134-a3d7-07c095c8cc1a None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:36.095933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe56b09-7b7c-4134-a3d7-07c095c8cc1a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:36.096073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe56b09-7b7c-4134-a3d7-07c095c8cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:36.114681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-5fe56b09-7b7c-4134-a3d7-07c095c8cc1a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:38:36.115967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5fe56b09-7b7c-4134-a3d7-07c095c8cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:38:36.187746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 623/1248] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:38:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:38:36.213073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85c1fb-a0ca-484f-98dd-e49b2e625e57 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:36.330524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85c1fb-a0ca-484f-98dd-e49b2e625e57 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:36.378475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d07a9-6d0e-4e8a-a048-e5e352f71c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:36.381557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d07a9-6d0e-4e8a-a048-e5e352f71c49 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:36.382097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d07a9-6d0e-4e8a-a048-e5e352f71c49 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:36.382415 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d07a9-6d0e-4e8a-a048-e5e352f71c49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:36.399806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d07a9-6d0e-4e8a-a048-e5e352f71c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-8f6d07a9-6d0e-4e8a-a048-e5e352f71c49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:38:36.407254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:36.408408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:36.409256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 626/1249] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:36.418568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe56b09-7b7c-4134-a3d7-07c095c8cc1a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:36.525097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe56b09-7b7c-4134-a3d7-07c095c8cc1a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:36.559622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae9ecb-c7d0-4497-b4ce-1a61549557d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:36.560390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae9ecb-c7d0-4497-b4ce-1a61549557d8 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:36.560719 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae9ecb-c7d0-4497-b4ce-1a61549557d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:36.561036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae9ecb-c7d0-4497-b4ce-1a61549557d8 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:36.561865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae9ecb-c7d0-4497-b4ce-1a61549557d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:36.562188 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae9ecb-c7d0-4497-b4ce-1a61549557d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:36.563796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae9ecb-c7d0-4497-b4ce-1a61549557d8 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:36.575628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 624/1250] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:38:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:36.581431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d07a9-6d0e-4e8a-a048-e5e352f71c49 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:36.698511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d07a9-6d0e-4e8a-a048-e5e352f71c49 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:36.736173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fedc9-2f6e-4b9e-9380-61abff03408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:36.737053 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fedc9-2f6e-4b9e-9380-61abff03408d None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:36.737335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fedc9-2f6e-4b9e-9380-61abff03408d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:36.737611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fedc9-2f6e-4b9e-9380-61abff03408d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:36.750519 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fedc9-2f6e-4b9e-9380-61abff03408d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:36.752226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fedc9-2f6e-4b9e-9380-61abff03408d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-2c5fedc9-2f6e-4b9e-9380-61abff03408d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:36.772159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:36.773329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:36.774443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:36.774443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:36.774443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:36.774443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:36.774443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 627/1251] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 18:38:36.782519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae9ecb-c7d0-4497-b4ce-1a61549557d8 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:36.891910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae9ecb-c7d0-4497-b4ce-1a61549557d8 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:36.928816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45334e-7804-47ce-97b0-8ee2990c37c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:36.929494 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45334e-7804-47ce-97b0-8ee2990c37c1 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:36.929835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45334e-7804-47ce-97b0-8ee2990c37c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:36.930115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45334e-7804-47ce-97b0-8ee2990c37c1 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:36.930898 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45334e-7804-47ce-97b0-8ee2990c37c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:36.932892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45334e-7804-47ce-97b0-8ee2990c37c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:36.932892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45334e-7804-47ce-97b0-8ee2990c37c1 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:36.946521 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 625/1252] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:36.952390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fedc9-2f6e-4b9e-9380-61abff03408d None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:37.061881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fedc9-2f6e-4b9e-9380-61abff03408d None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:37.099421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0b4ea-b61a-4a9e-acb4-5034781255e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:37.100258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b4ea-b61a-4a9e-acb4-5034781255e4 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:37.100540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b4ea-b61a-4a9e-acb4-5034781255e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:37.100815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b4ea-b61a-4a9e-acb4-5034781255e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:37.109120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0b4ea-b61a-4a9e-acb4-5034781255e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:37.110849 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0b4ea-b61a-4a9e-acb4-5034781255e4 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-a5f0b4ea-b61a-4a9e-acb4-5034781255e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:38:37.127365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:37.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:37.130425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:37.130425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:37.130425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:38:37.130425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:38:37.130425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:38:37.130425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:38:37.130425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:38:37.130425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:38:37.130425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:37.130425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:37.130425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 628/1253] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:37.135021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45334e-7804-47ce-97b0-8ee2990c37c1 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:37.240785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45334e-7804-47ce-97b0-8ee2990c37c1 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:37.276961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bf0fc-1467-42f1-9d76-3d9cb7dca556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:37.277779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bf0fc-1467-42f1-9d76-3d9cb7dca556 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:37.278127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bf0fc-1467-42f1-9d76-3d9cb7dca556 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:37.278427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bf0fc-1467-42f1-9d76-3d9cb7dca556 None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:37.279512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bf0fc-1467-42f1-9d76-3d9cb7dca556 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:37.279959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bf0fc-1467-42f1-9d76-3d9cb7dca556 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:37.281715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bf0fc-1467-42f1-9d76-3d9cb7dca556 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:37.300878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 626/1254] 10.222.0.72 () {56 vars in 1143 bytes} [Mon May 16 18:38:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:38:37.307155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0b4ea-b61a-4a9e-acb4-5034781255e4 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:37.416847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0b4ea-b61a-4a9e-acb4-5034781255e4 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:37.454240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431fb2b-9585-4ce8-8d00-5a20da1ce47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:37.455337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431fb2b-9585-4ce8-8d00-5a20da1ce47e None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:37.455871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431fb2b-9585-4ce8-8d00-5a20da1ce47e None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:37.456357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431fb2b-9585-4ce8-8d00-5a20da1ce47e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:37.554358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431fb2b-9585-4ce8-8d00-5a20da1ce47e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:37.556203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431fb2b-9585-4ce8-8d00-5a20da1ce47e None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:37.666775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 629/1255] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:38:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 18:38:37.668378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bf0fc-1467-42f1-9d76-3d9cb7dca556 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:37.777931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bf0fc-1467-42f1-9d76-3d9cb7dca556 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:37.816741 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f639f-7bf3-4a84-80e1-f1aac86597cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:37.817696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f639f-7bf3-4a84-80e1-f1aac86597cb None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:37.817979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f639f-7bf3-4a84-80e1-f1aac86597cb None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:37.818315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f639f-7bf3-4a84-80e1-f1aac86597cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:37.829582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f639f-7bf3-4a84-80e1-f1aac86597cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:37.831274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f639f-7bf3-4a84-80e1-f1aac86597cb None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-831f639f-7bf3-4a84-80e1-f1aac86597cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:37.850830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:37.851960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:37.852979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:37.852979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:37.852979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:37.852979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:37.852979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 627/1256] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:37.857779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431fb2b-9585-4ce8-8d00-5a20da1ce47e None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:37.976754 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431fb2b-9585-4ce8-8d00-5a20da1ce47e None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:38.014552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eacb9f-d461-4606-98d9-320422749bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:38.015244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eacb9f-d461-4606-98d9-320422749bd6 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:38.015526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eacb9f-d461-4606-98d9-320422749bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:38.015851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eacb9f-d461-4606-98d9-320422749bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:38.016601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eacb9f-d461-4606-98d9-320422749bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:38.016910 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eacb9f-d461-4606-98d9-320422749bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:38.018452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eacb9f-d461-4606-98d9-320422749bd6 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:38.031182 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 630/1257] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:38.037526 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f639f-7bf3-4a84-80e1-f1aac86597cb None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:38.140383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f639f-7bf3-4a84-80e1-f1aac86597cb None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:38.176188 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895239e-21dc-42b3-960b-b619dcf23b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:38.177057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895239e-21dc-42b3-960b-b619dcf23b0e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:38.177341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895239e-21dc-42b3-960b-b619dcf23b0e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:38.177628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895239e-21dc-42b3-960b-b619dcf23b0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:38.185051 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895239e-21dc-42b3-960b-b619dcf23b0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:38.186443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895239e-21dc-42b3-960b-b619dcf23b0e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-e895239e-21dc-42b3-960b-b619dcf23b0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:38:38.201076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:38.202233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:38.208671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:38:38.208671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:38:38.208671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:38:38.208671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:38:38.208671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:38:38.208671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:38:38.208671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:38.208671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:38.208671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 628/1258] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:38:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:38.209353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eacb9f-d461-4606-98d9-320422749bd6 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:38.313226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eacb9f-d461-4606-98d9-320422749bd6 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:38.355679 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51b288-5c42-4a56-94c9-0cfac2b73770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:38.356415 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b288-5c42-4a56-94c9-0cfac2b73770 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:38.356695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b288-5c42-4a56-94c9-0cfac2b73770 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:38.357039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51b288-5c42-4a56-94c9-0cfac2b73770 None admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:38.357941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51b288-5c42-4a56-94c9-0cfac2b73770 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:38.358225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51b288-5c42-4a56-94c9-0cfac2b73770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:38.359856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51b288-5c42-4a56-94c9-0cfac2b73770 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:38.375141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 631/1259] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:38:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:38.382168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895239e-21dc-42b3-960b-b619dcf23b0e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:38.481233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895239e-21dc-42b3-960b-b619dcf23b0e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:38.514390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27b1cd-bcac-4282-aa4e-ac3f82195cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:38.515047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27b1cd-bcac-4282-aa4e-ac3f82195cc3 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:38.515327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27b1cd-bcac-4282-aa4e-ac3f82195cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:38.515602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27b1cd-bcac-4282-aa4e-ac3f82195cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:38.516491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27b1cd-bcac-4282-aa4e-ac3f82195cc3 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=443fd569cd1b4f6db86d575ed669e26a) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:38.516798 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27b1cd-bcac-4282-aa4e-ac3f82195cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:38.518230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27b1cd-bcac-4282-aa4e-ac3f82195cc3 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:38.523919 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 629/1260] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:38:38 2022] GET /identity/v3/role_assignments?user.id=443fd569cd1b4f6db86d575ed669e26a&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=b104fd2e772843a0974990f965d8b589 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:40.762033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b879f-7bed-4e33-884a-f4d1c237ee83 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:40.762578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b879f-7bed-4e33-884a-f4d1c237ee83 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:40.762578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b879f-7bed-4e33-884a-f4d1c237ee83 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:40.763961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 632/1261] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:38:40.769263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0cf3-19a3-45bf-ad48-4105890fefc3 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:40.769712 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0cf3-19a3-45bf-ad48-4105890fefc3 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:40.769808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0cf3-19a3-45bf-ad48-4105890fefc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:40.786610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-bf5a0cf3-19a3-45bf-ad48-4105890fefc3 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:38:40.787803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-bf5a0cf3-19a3-45bf-ad48-4105890fefc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:38:40.849896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 630/1262] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:38:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 18:38:40.872307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b879f-7bed-4e33-884a-f4d1c237ee83 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:40.967887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b879f-7bed-4e33-884a-f4d1c237ee83 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:41.004004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9bf2e-64cb-4642-9d7d-c60add0df4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:41.005297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9bf2e-64cb-4642-9d7d-c60add0df4b6 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:41.005573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9bf2e-64cb-4642-9d7d-c60add0df4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:41.005844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9bf2e-64cb-4642-9d7d-c60add0df4b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:41.015420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9bf2e-64cb-4642-9d7d-c60add0df4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-aea9bf2e-64cb-4642-9d7d-c60add0df4b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:38:41.023467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:41.024617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:41.025660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 633/1263] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:38:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:41.030594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a0cf3-19a3-45bf-ad48-4105890fefc3 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:41.122584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a0cf3-19a3-45bf-ad48-4105890fefc3 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:41.153958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844601e-3d32-4d4e-bba3-3f24eb5df8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:41.154616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844601e-3d32-4d4e-bba3-3f24eb5df8b4 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:41.154901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844601e-3d32-4d4e-bba3-3f24eb5df8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:41.155178 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844601e-3d32-4d4e-bba3-3f24eb5df8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:41.155945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844601e-3d32-4d4e-bba3-3f24eb5df8b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:41.156251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844601e-3d32-4d4e-bba3-3f24eb5df8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:41.157632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844601e-3d32-4d4e-bba3-3f24eb5df8b4 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:41.165312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 631/1264] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:38:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:41.170947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9bf2e-64cb-4642-9d7d-c60add0df4b6 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:41.265557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9bf2e-64cb-4642-9d7d-c60add0df4b6 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:41.296295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c8a5d-1e86-499f-9c20-4744110087f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:41.297068 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c8a5d-1e86-499f-9c20-4744110087f2 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:41.297349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c8a5d-1e86-499f-9c20-4744110087f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:41.297622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c8a5d-1e86-499f-9c20-4744110087f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:41.308149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c8a5d-1e86-499f-9c20-4744110087f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:41.309583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c8a5d-1e86-499f-9c20-4744110087f2 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-ea5c8a5d-1e86-499f-9c20-4744110087f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:41.328982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:41.330000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:41.335634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:41.335634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:41.335634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:41.335634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:41.335634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 634/1265] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:41.336160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844601e-3d32-4d4e-bba3-3f24eb5df8b4 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:41.440828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844601e-3d32-4d4e-bba3-3f24eb5df8b4 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:41.472587 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7937d5-5c92-413b-aaca-23c7372a02f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:41.474248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7937d5-5c92-413b-aaca-23c7372a02f6 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:41.474248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7937d5-5c92-413b-aaca-23c7372a02f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:41.474248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7937d5-5c92-413b-aaca-23c7372a02f6 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:41.474669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7937d5-5c92-413b-aaca-23c7372a02f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:41.474973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7937d5-5c92-413b-aaca-23c7372a02f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:41.476354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7937d5-5c92-413b-aaca-23c7372a02f6 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:41.487426 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 632/1266] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:41.493646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c8a5d-1e86-499f-9c20-4744110087f2 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:41.586794 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c8a5d-1e86-499f-9c20-4744110087f2 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:41.619329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c0475-b803-4a88-ba03-ca67c5483a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:41.620149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0475-b803-4a88-ba03-ca67c5483a5c None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:41.620428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0475-b803-4a88-ba03-ca67c5483a5c None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:41.620697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0475-b803-4a88-ba03-ca67c5483a5c None admin] PATH_INFO: `/v3/users/placement` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:41.627803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c0475-b803-4a88-ba03-ca67c5483a5c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:41.629214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c0475-b803-4a88-ba03-ca67c5483a5c None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-e12c0475-b803-4a88-ba03-ca67c5483a5c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:38:41.642813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:41.643921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:41.645416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:41.645416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:41.645416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:38:41.645416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:38:41.645416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:38:41.645416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:38:41.645416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:38:41.645416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:38:41.645416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:41.645416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:41.645416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 635/1267] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:41.649833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7937d5-5c92-413b-aaca-23c7372a02f6 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:41.742627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7937d5-5c92-413b-aaca-23c7372a02f6 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:41.773477 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197e411-ff72-4498-8f99-02caf88b4f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:41.774137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197e411-ff72-4498-8f99-02caf88b4f6d None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:41.774415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197e411-ff72-4498-8f99-02caf88b4f6d None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:41.774686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197e411-ff72-4498-8f99-02caf88b4f6d None admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:41.775512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197e411-ff72-4498-8f99-02caf88b4f6d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:41.775847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197e411-ff72-4498-8f99-02caf88b4f6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:41.777257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197e411-ff72-4498-8f99-02caf88b4f6d None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:41.793857 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 633/1268] 10.222.0.72 () {56 vars in 1143 bytes} [Mon May 16 18:38:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:41.799432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c0475-b803-4a88-ba03-ca67c5483a5c None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:41.893121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c0475-b803-4a88-ba03-ca67c5483a5c None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:41.926397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ebcf7-df39-4c0b-8681-88f3e3f59182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:41.927259 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ebcf7-df39-4c0b-8681-88f3e3f59182 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:41.927539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ebcf7-df39-4c0b-8681-88f3e3f59182 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:41.927855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ebcf7-df39-4c0b-8681-88f3e3f59182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:41.938040 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ebcf7-df39-4c0b-8681-88f3e3f59182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:41.939549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ebcf7-df39-4c0b-8681-88f3e3f59182 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-e38ebcf7-df39-4c0b-8681-88f3e3f59182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:41.956081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:41.957094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:41.958654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:41.958654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:41.958654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:41.958654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:41.958654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 636/1269] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:41.963555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197e411-ff72-4498-8f99-02caf88b4f6d None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:42.056903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197e411-ff72-4498-8f99-02caf88b4f6d None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:42.088793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28d3a-9119-4c53-9143-a1b6adfe60d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:42.089448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28d3a-9119-4c53-9143-a1b6adfe60d8 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:42.089731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28d3a-9119-4c53-9143-a1b6adfe60d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:42.090009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28d3a-9119-4c53-9143-a1b6adfe60d8 None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:42.090720 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca28d3a-9119-4c53-9143-a1b6adfe60d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:42.091025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca28d3a-9119-4c53-9143-a1b6adfe60d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:42.092664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca28d3a-9119-4c53-9143-a1b6adfe60d8 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:42.103787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 634/1270] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:42.109403 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ebcf7-df39-4c0b-8681-88f3e3f59182 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:42.202913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ebcf7-df39-4c0b-8681-88f3e3f59182 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:42.235144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc55080-ac0f-4502-bf7d-cfe905cca24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:42.235946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55080-ac0f-4502-bf7d-cfe905cca24a None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:42.236225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55080-ac0f-4502-bf7d-cfe905cca24a None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:42.236497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc55080-ac0f-4502-bf7d-cfe905cca24a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:42.243281 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc55080-ac0f-4502-bf7d-cfe905cca24a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:42.244751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc55080-ac0f-4502-bf7d-cfe905cca24a None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-6fc55080-ac0f-4502-bf7d-cfe905cca24a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:38:42.259039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:42.260136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:42.261242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:38:42.261242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:38:42.261242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:38:42.261242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:38:42.261242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:38:42.261242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:38:42.261242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:42.261242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:42.261242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 637/1271] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:38:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:42.265954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28d3a-9119-4c53-9143-a1b6adfe60d8 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:42.371358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28d3a-9119-4c53-9143-a1b6adfe60d8 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:42.404135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fc36f-be68-459d-9a1c-3cc30e76c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:42.404785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fc36f-be68-459d-9a1c-3cc30e76c5c7 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:42.405063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fc36f-be68-459d-9a1c-3cc30e76c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:42.405334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fc36f-be68-459d-9a1c-3cc30e76c5c7 None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:42.406111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fc36f-be68-459d-9a1c-3cc30e76c5c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:42.406414 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fc36f-be68-459d-9a1c-3cc30e76c5c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:42.407859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fc36f-be68-459d-9a1c-3cc30e76c5c7 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:42.419229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 635/1272] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:38:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:42.425183 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc55080-ac0f-4502-bf7d-cfe905cca24a None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:42.520889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc55080-ac0f-4502-bf7d-cfe905cca24a None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:42.552334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7e559-1880-4d7f-8dc5-da4ad7f9c20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:42.553205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7e559-1880-4d7f-8dc5-da4ad7f9c20d None admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:42.553485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7e559-1880-4d7f-8dc5-da4ad7f9c20d None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:42.553756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7e559-1880-4d7f-8dc5-da4ad7f9c20d None admin] PATH_INFO: `/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/443fd569cd1b4f6db86d575ed669e26a/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:42.555664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7e559-1880-4d7f-8dc5-da4ad7f9c20d None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c8b57010645c6919f27faff7ede89, user_id=443fd569cd1b4f6db86d575ed669e26a, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:42.557103 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7e559-1880-4d7f-8dc5-da4ad7f9c20d None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:42.569765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 638/1273] 10.222.0.72 () {58 vars in 1439 bytes} [Mon May 16 18:38:42 2022] PUT /identity/v3/projects/1f8c8b57010645c6919f27faff7ede89/users/443fd569cd1b4f6db86d575ed669e26a/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:38:44.768902 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a174a1-7663-4c64-bcf1-51b9ab86627c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:44.769476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a174a1-7663-4c64-bcf1-51b9ab86627c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:44.769476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a174a1-7663-4c64-bcf1-51b9ab86627c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:44.770954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 636/1274] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:38:44.776325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1122aa-58b8-4699-8095-e6aa88202ad9 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:44.776789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1122aa-58b8-4699-8095-e6aa88202ad9 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:44.776886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1122aa-58b8-4699-8095-e6aa88202ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:44.793599 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-fd1122aa-58b8-4699-8095-e6aa88202ad9 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:38:44.794760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-fd1122aa-58b8-4699-8095-e6aa88202ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:38:44.857332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 639/1275] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:38:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:38:44.880959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a174a1-7663-4c64-bcf1-51b9ab86627c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:44.978234 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a174a1-7663-4c64-bcf1-51b9ab86627c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:45.009569 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89011e3-d33d-49ae-ada9-cf706f328da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:45.010349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89011e3-d33d-49ae-ada9-cf706f328da3 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:45.010630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89011e3-d33d-49ae-ada9-cf706f328da3 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:45.010904 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89011e3-d33d-49ae-ada9-cf706f328da3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:45.021110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89011e3-d33d-49ae-ada9-cf706f328da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-f89011e3-d33d-49ae-ada9-cf706f328da3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 18:38:45.028566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:45.029633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:45.030843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 637/1276] 10.222.0.72 () {56 vars in 1096 bytes} [Mon May 16 18:38:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:45.036348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1122aa-58b8-4699-8095-e6aa88202ad9 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:45.128137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1122aa-58b8-4699-8095-e6aa88202ad9 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:45.160096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47645a80-4519-426a-ba70-99618336b51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:45.161285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645a80-4519-426a-ba70-99618336b51b None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:45.161643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645a80-4519-426a-ba70-99618336b51b None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:45.161918 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645a80-4519-426a-ba70-99618336b51b None admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:45.162661 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47645a80-4519-426a-ba70-99618336b51b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:45.162959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47645a80-4519-426a-ba70-99618336b51b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:45.164435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47645a80-4519-426a-ba70-99618336b51b None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:45.172134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 640/1277] 10.222.0.72 () {56 vars in 1099 bytes} [Mon May 16 18:38:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:45.177693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89011e3-d33d-49ae-ada9-cf706f328da3 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:45.273571 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89011e3-d33d-49ae-ada9-cf706f328da3 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:45.304128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99fb44-75d3-4733-a476-b5c5321ca1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:45.304904 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99fb44-75d3-4733-a476-b5c5321ca1e2 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:45.305189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99fb44-75d3-4733-a476-b5c5321ca1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:45.305463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99fb44-75d3-4733-a476-b5c5321ca1e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:45.316145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99fb44-75d3-4733-a476-b5c5321ca1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:45.318303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99fb44-75d3-4733-a476-b5c5321ca1e2 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-9c99fb44-75d3-4733-a476-b5c5321ca1e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:45.338251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:45.339491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:45.340765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:45.340765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:45.340765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:45.340765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:45.340765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 638/1278] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:45.346019 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47645a80-4519-426a-ba70-99618336b51b None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:45.448508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47645a80-4519-426a-ba70-99618336b51b None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:45.480315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0f1d6-165b-4655-91d0-fd8218a1c4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:45.480965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0f1d6-165b-4655-91d0-fd8218a1c4af None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:45.481245 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0f1d6-165b-4655-91d0-fd8218a1c4af None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:45.481520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0f1d6-165b-4655-91d0-fd8218a1c4af None admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:45.482232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0f1d6-165b-4655-91d0-fd8218a1c4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:45.482536 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0f1d6-165b-4655-91d0-fd8218a1c4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:45.483911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0f1d6-165b-4655-91d0-fd8218a1c4af None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:45.495133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 641/1279] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:45.500961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99fb44-75d3-4733-a476-b5c5321ca1e2 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:45.595892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99fb44-75d3-4733-a476-b5c5321ca1e2 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:45.627355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42076d69-bf2f-45fe-8759-c29b519544f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:45.628175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42076d69-bf2f-45fe-8759-c29b519544f1 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:45.628456 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42076d69-bf2f-45fe-8759-c29b519544f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:45.628731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42076d69-bf2f-45fe-8759-c29b519544f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:45.636320 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42076d69-bf2f-45fe-8759-c29b519544f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:45.637739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42076d69-bf2f-45fe-8759-c29b519544f1 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-42076d69-bf2f-45fe-8759-c29b519544f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 18:38:45.651346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:45.652515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:45.653531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:45.653531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:45.653531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 18:38:45.653531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 18:38:45.653531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 18:38:45.653531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 18:38:45.653531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 18:38:45.653531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 18:38:45.653531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 18:38:45.653531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:45.653531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 639/1280] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:45.658308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0f1d6-165b-4655-91d0-fd8218a1c4af None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:45.750852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0f1d6-165b-4655-91d0-fd8218a1c4af None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:45.782466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b2be-ba4d-4365-8146-81905b8d2aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:45.783123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b2be-ba4d-4365-8146-81905b8d2aa7 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:45.783397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b2be-ba4d-4365-8146-81905b8d2aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:45.783665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b2be-ba4d-4365-8146-81905b8d2aa7 None admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:45.784521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951b2be-ba4d-4365-8146-81905b8d2aa7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:45.784823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951b2be-ba4d-4365-8146-81905b8d2aa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:45.786432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951b2be-ba4d-4365-8146-81905b8d2aa7 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:45.802851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 642/1281] 10.222.0.72 () {56 vars in 1143 bytes} [Mon May 16 18:38:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:45.808425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42076d69-bf2f-45fe-8759-c29b519544f1 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:45.901484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42076d69-bf2f-45fe-8759-c29b519544f1 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:45.933023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb71bca-7857-4c3c-8717-9115f11be96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:45.933669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb71bca-7857-4c3c-8717-9115f11be96e None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:45.933949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb71bca-7857-4c3c-8717-9115f11be96e None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:45.934224 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb71bca-7857-4c3c-8717-9115f11be96e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:45.996256 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb71bca-7857-4c3c-8717-9115f11be96e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:45.997686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb71bca-7857-4c3c-8717-9115f11be96e None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:46.089955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 640/1282] 10.222.0.72 () {58 vars in 1282 bytes} [Mon May 16 18:38:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 18:38:46.095987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b2be-ba4d-4365-8146-81905b8d2aa7 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:46.190917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b2be-ba4d-4365-8146-81905b8d2aa7 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:46.222626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba765b-9f14-433e-835d-ac447b5de7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:46.224090 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba765b-9f14-433e-835d-ac447b5de7ba None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:46.224368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba765b-9f14-433e-835d-ac447b5de7ba None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:46.224642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba765b-9f14-433e-835d-ac447b5de7ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:46.234031 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba765b-9f14-433e-835d-ac447b5de7ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:46.235460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba765b-9f14-433e-835d-ac447b5de7ba None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-66ba765b-9f14-433e-835d-ac447b5de7ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 18:38:46.252697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:46.253840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:46.255110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 18:38:46.255110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 18:38:46.255110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 18:38:46.255110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:46.255110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 643/1283] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:46.259538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb71bca-7857-4c3c-8717-9115f11be96e None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:46.357406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb71bca-7857-4c3c-8717-9115f11be96e None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:46.389428 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a076e2-0c18-4b8c-8202-10dd2076c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:46.390078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a076e2-0c18-4b8c-8202-10dd2076c5ac None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:46.390359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a076e2-0c18-4b8c-8202-10dd2076c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:46.390631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a076e2-0c18-4b8c-8202-10dd2076c5ac None admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:46.391340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a076e2-0c18-4b8c-8202-10dd2076c5ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:46.391693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a076e2-0c18-4b8c-8202-10dd2076c5ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:46.393027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a076e2-0c18-4b8c-8202-10dd2076c5ac None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:46.404053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 641/1284] 10.222.0.72 () {56 vars in 1109 bytes} [Mon May 16 18:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:46.409630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba765b-9f14-433e-835d-ac447b5de7ba None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:46.504723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba765b-9f14-433e-835d-ac447b5de7ba None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:46.537380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824258ec-4e3c-4c53-ab25-a033703e0045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:46.538159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824258ec-4e3c-4c53-ab25-a033703e0045 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:46.538440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824258ec-4e3c-4c53-ab25-a033703e0045 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:46.538713 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824258ec-4e3c-4c53-ab25-a033703e0045 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:46.545042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824258ec-4e3c-4c53-ab25-a033703e0045 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:46.546468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824258ec-4e3c-4c53-ab25-a033703e0045 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application [None req-824258ec-4e3c-4c53-ab25-a033703e0045 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 18:38:46.560020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application with Lock( May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:46.561018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:46.566207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 18:38:46.566207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 18:38:46.566207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 18:38:46.566207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 18:38:46.566207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 18:38:46.566207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 18:38:46.566207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 18:38:46.566207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: ERROR keystone.server.flask.application May 16 18:38:46.566207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 644/1285] 10.222.0.72 () {56 vars in 1111 bytes} [Mon May 16 18:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:46.566985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a076e2-0c18-4b8c-8202-10dd2076c5ac None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:46.660161 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a076e2-0c18-4b8c-8202-10dd2076c5ac None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:46.693324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1a1ec-f7f4-4ec3-9782-e21bae17d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:46.693971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a1ec-f7f4-4ec3-9782-e21bae17d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:46.694258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a1ec-f7f4-4ec3-9782-e21bae17d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:46.694542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a1ec-f7f4-4ec3-9782-e21bae17d8a0 None admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:46.695325 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1a1ec-f7f4-4ec3-9782-e21bae17d8a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:46.695631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1a1ec-f7f4-4ec3-9782-e21bae17d8a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:46.697074 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1a1ec-f7f4-4ec3-9782-e21bae17d8a0 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:46.708939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 642/1286] 10.222.0.72 () {56 vars in 1148 bytes} [Mon May 16 18:38:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:46.714866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824258ec-4e3c-4c53-ab25-a033703e0045 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:46.810334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824258ec-4e3c-4c53-ab25-a033703e0045 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:46.843047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044b281-6f0b-4980-95d2-f8c188525b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:46.843685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b281-6f0b-4980-95d2-f8c188525b55 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:46.843997 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b281-6f0b-4980-95d2-f8c188525b55 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:46.844269 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b281-6f0b-4980-95d2-f8c188525b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:46.845184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044b281-6f0b-4980-95d2-f8c188525b55 None admin] RBAC: Adding query filter params (role.id=b104fd2e772843a0974990f965d8b589, scope.project.id=1f8c8b57010645c6919f27faff7ede89, user.id=443fd569cd1b4f6db86d575ed669e26a) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:46.845499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044b281-6f0b-4980-95d2-f8c188525b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:46.846913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044b281-6f0b-4980-95d2-f8c188525b55 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:46.852664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 645/1287] 10.222.0.72 () {56 vars in 1374 bytes} [Mon May 16 18:38:46 2022] GET /identity/v3/role_assignments?user.id=443fd569cd1b4f6db86d575ed669e26a&scope.project.id=1f8c8b57010645c6919f27faff7ede89&role.id=b104fd2e772843a0974990f965d8b589 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:49.067973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a9bfa-6763-4e60-a03b-197398eda8ac None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:49.068505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a9bfa-6763-4e60-a03b-197398eda8ac None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:49.068505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a9bfa-6763-4e60-a03b-197398eda8ac None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:49.069887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 643/1288] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:38:49.075191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f07934-1a0d-420e-99bf-9ce5fcc6d66f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:49.075639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f07934-1a0d-420e-99bf-9ce5fcc6d66f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:49.075767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f07934-1a0d-420e-99bf-9ce5fcc6d66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:49.092987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d1f07934-1a0d-420e-99bf-9ce5fcc6d66f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:38:49.094155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d1f07934-1a0d-420e-99bf-9ce5fcc6d66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:38:49.156375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 646/1289] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:38:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:38:49.177687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a9bfa-6763-4e60-a03b-197398eda8ac None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:49.271694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a9bfa-6763-4e60-a03b-197398eda8ac None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:49.302561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363b1b8-e273-4602-8829-7363d86d9f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:49.303338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b1b8-e273-4602-8829-7363d86d9f28 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:49.303617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b1b8-e273-4602-8829-7363d86d9f28 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:49.303919 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b1b8-e273-4602-8829-7363d86d9f28 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:49.304568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363b1b8-e273-4602-8829-7363d86d9f28 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:49.305915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363b1b8-e273-4602-8829-7363d86d9f28 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-b363b1b8-e273-4602-8829-7363d86d9f28 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:49.318735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:49.326949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:49.328283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 644/1290] 10.222.0.72 () {56 vars in 1117 bytes} [Mon May 16 18:38:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:49.329346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f07934-1a0d-420e-99bf-9ce5fcc6d66f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:49.438644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f07934-1a0d-420e-99bf-9ce5fcc6d66f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:49.471219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff208be-7c1a-4eb4-8c12-911239582647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:49.471908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff208be-7c1a-4eb4-8c12-911239582647 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:49.472190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff208be-7c1a-4eb4-8c12-911239582647 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:49.472464 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff208be-7c1a-4eb4-8c12-911239582647 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:49.473376 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff208be-7c1a-4eb4-8c12-911239582647 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:49.473899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff208be-7c1a-4eb4-8c12-911239582647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:49.475401 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff208be-7c1a-4eb4-8c12-911239582647 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:49.480046 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 647/1291] 10.222.0.72 () {56 vars in 1116 bytes} [Mon May 16 18:38:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:49.485762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363b1b8-e273-4602-8829-7363d86d9f28 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:49.578792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363b1b8-e273-4602-8829-7363d86d9f28 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:49.609635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bc001-30c4-4846-ae77-0c32952ea8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:49.610277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc001-30c4-4846-ae77-0c32952ea8d2 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:49.610557 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc001-30c4-4846-ae77-0c32952ea8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:49.610830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc001-30c4-4846-ae77-0c32952ea8d2 None admin] PATH_INFO: `/v3/services` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:49.611525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bc001-30c4-4846-ae77-0c32952ea8d2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:49.611860 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bc001-30c4-4846-ae77-0c32952ea8d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:49.613217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bc001-30c4-4846-ae77-0c32952ea8d2 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:49.617969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 645/1292] 10.222.0.72 () {56 vars in 1116 bytes} [Mon May 16 18:38:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:51.913447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e02d49-b434-451b-ae4f-1c1122e8d9af None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:51.913977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e02d49-b434-451b-ae4f-1c1122e8d9af None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:51.913977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e02d49-b434-451b-ae4f-1c1122e8d9af None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:51.915697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 648/1293] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:38:51.921181 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a67524-b29b-4d7b-9340-ec6bdca41185 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:51.921602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a67524-b29b-4d7b-9340-ec6bdca41185 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:51.921746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a67524-b29b-4d7b-9340-ec6bdca41185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:51.938133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-93a67524-b29b-4d7b-9340-ec6bdca41185 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:38:51.939394 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-93a67524-b29b-4d7b-9340-ec6bdca41185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:38:52.001756 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 646/1294] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:38:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:38:52.025247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e02d49-b434-451b-ae4f-1c1122e8d9af None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:52.119910 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e02d49-b434-451b-ae4f-1c1122e8d9af None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:52.155219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14aa37-8ac3-42f6-8351-b32aa7aca1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:52.155896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14aa37-8ac3-42f6-8351-b32aa7aca1bd None admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:52.156174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14aa37-8ac3-42f6-8351-b32aa7aca1bd None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:52.156446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14aa37-8ac3-42f6-8351-b32aa7aca1bd None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:52.157243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14aa37-8ac3-42f6-8351-b32aa7aca1bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:52.158585 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14aa37-8ac3-42f6-8351-b32aa7aca1bd None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:52.171111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 649/1295] 10.222.0.72 () {60 vars in 1141 bytes} [Mon May 16 18:38:52 2022] POST /identity/v3/services => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:38:54.405818 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c091b1-10c0-4aa0-8de8-4317c4379900 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:54.406374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c091b1-10c0-4aa0-8de8-4317c4379900 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:54.406374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c091b1-10c0-4aa0-8de8-4317c4379900 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:54.407750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 647/1296] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:38:54.412967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5d27c-7f04-4afe-92cf-e66dc0885d1d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:54.413413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5d27c-7f04-4afe-92cf-e66dc0885d1d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:54.413506 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5d27c-7f04-4afe-92cf-e66dc0885d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:54.429596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-9ec5d27c-7f04-4afe-92cf-e66dc0885d1d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:38:54.430787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9ec5d27c-7f04-4afe-92cf-e66dc0885d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:38:54.498520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 650/1297] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:38:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:38:54.522500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c091b1-10c0-4aa0-8de8-4317c4379900 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:54.618349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c091b1-10c0-4aa0-8de8-4317c4379900 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:54.649678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71189960-07c5-48d7-8a86-c6a528d088a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:54.650457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71189960-07c5-48d7-8a86-c6a528d088a8 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:54.650736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71189960-07c5-48d7-8a86-c6a528d088a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:54.651004 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71189960-07c5-48d7-8a86-c6a528d088a8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:54.651641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71189960-07c5-48d7-8a86-c6a528d088a8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:54.653037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71189960-07c5-48d7-8a86-c6a528d088a8 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-71189960-07c5-48d7-8a86-c6a528d088a8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:54.665278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:54.666419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:54.667600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 648/1298] 10.222.0.72 () {56 vars in 1117 bytes} [Mon May 16 18:38:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:54.672376 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5d27c-7f04-4afe-92cf-e66dc0885d1d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:54.782844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5d27c-7f04-4afe-92cf-e66dc0885d1d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:54.821144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f5d1e-62a9-492a-b29d-844ff572a718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:54.821815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f5d1e-62a9-492a-b29d-844ff572a718 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:54.822096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f5d1e-62a9-492a-b29d-844ff572a718 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:54.822373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f5d1e-62a9-492a-b29d-844ff572a718 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:54.823091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f5d1e-62a9-492a-b29d-844ff572a718 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:54.823395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f5d1e-62a9-492a-b29d-844ff572a718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:54.824796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f5d1e-62a9-492a-b29d-844ff572a718 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:54.829870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 651/1299] 10.222.0.72 () {56 vars in 1116 bytes} [Mon May 16 18:38:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:54.836443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71189960-07c5-48d7-8a86-c6a528d088a8 None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:54.941090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71189960-07c5-48d7-8a86-c6a528d088a8 None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:54.974820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17757a56-067d-4515-bea8-1d85afff6655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:54.975479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757a56-067d-4515-bea8-1d85afff6655 None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:54.975783 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757a56-067d-4515-bea8-1d85afff6655 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:54.976061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17757a56-067d-4515-bea8-1d85afff6655 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:54.976843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17757a56-067d-4515-bea8-1d85afff6655 None admin] RBAC: Adding query filter params (interface=public, service_id=b4ab973ac28e4c708f9eaa6385619447, region_id=RegionOne) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:54.977152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17757a56-067d-4515-bea8-1d85afff6655 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:54.978594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17757a56-067d-4515-bea8-1d85afff6655 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:54.983524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 649/1300] 10.222.0.72 () {56 vars in 1251 bytes} [Mon May 16 18:38:54 2022] GET /identity/v3/endpoints?service_id=b4ab973ac28e4c708f9eaa6385619447&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:54.989202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f5d1e-62a9-492a-b29d-844ff572a718 None admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:55.103987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f5d1e-62a9-492a-b29d-844ff572a718 None admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:55.136187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9db859-a042-4334-94d9-68e0e3a17cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:55.136840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db859-a042-4334-94d9-68e0e3a17cc8 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:55.137121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db859-a042-4334-94d9-68e0e3a17cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:55.137396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db859-a042-4334-94d9-68e0e3a17cc8 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:55.138069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9db859-a042-4334-94d9-68e0e3a17cc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:55.139421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9db859-a042-4334-94d9-68e0e3a17cc8 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:55.147055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 652/1301] 10.222.0.72 () {56 vars in 1087 bytes} [Mon May 16 18:38:54 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:38:57.359661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef937b-d017-4cb1-a65e-b7b24b34bc8f None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:57.360229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef937b-d017-4cb1-a65e-b7b24b34bc8f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:57.360229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef937b-d017-4cb1-a65e-b7b24b34bc8f None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:57.361521 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 650/1302] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:38:57.369055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319252-6b0a-4de1-aefd-49cd2f904927 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:57.369521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319252-6b0a-4de1-aefd-49cd2f904927 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:57.369872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3319252-6b0a-4de1-aefd-49cd2f904927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:57.386338 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-f3319252-6b0a-4de1-aefd-49cd2f904927 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:38:57.387487 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-f3319252-6b0a-4de1-aefd-49cd2f904927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:38:57.454872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 653/1303] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:38:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 18:38:57.477726 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef937b-d017-4cb1-a65e-b7b24b34bc8f None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:57.574373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef937b-d017-4cb1-a65e-b7b24b34bc8f None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:57.606458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953515a-de75-43b2-803b-dcb947f283ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:57.607240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953515a-de75-43b2-803b-dcb947f283ba None admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:57.607526 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953515a-de75-43b2-803b-dcb947f283ba None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:57.607830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953515a-de75-43b2-803b-dcb947f283ba None admin] PATH_INFO: `/v3/services/placement` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:57.608485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953515a-de75-43b2-803b-dcb947f283ba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:57.609889 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953515a-de75-43b2-803b-dcb947f283ba None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application [None req-d953515a-de75-43b2-803b-dcb947f283ba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 18:38:57.621721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 18:38:57.622863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.get_or_create( May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application with Lock( May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self._enter() May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application return self.creator() May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application created_value = creator( May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: ERROR keystone.server.flask.application May 16 18:38:57.624014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 651/1304] 10.222.0.72 () {56 vars in 1117 bytes} [Mon May 16 18:38:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 18:38:57.629693 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3319252-6b0a-4de1-aefd-49cd2f904927 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:57.722329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3319252-6b0a-4de1-aefd-49cd2f904927 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:57.754705 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec57a21-9161-4fd0-82c2-92f6e83ea4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:57.755355 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec57a21-9161-4fd0-82c2-92f6e83ea4b3 None admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:57.755634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec57a21-9161-4fd0-82c2-92f6e83ea4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:57.755935 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec57a21-9161-4fd0-82c2-92f6e83ea4b3 None admin] PATH_INFO: `/v3/services` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:57.756635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec57a21-9161-4fd0-82c2-92f6e83ea4b3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:38:57.756938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec57a21-9161-4fd0-82c2-92f6e83ea4b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:57.758291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec57a21-9161-4fd0-82c2-92f6e83ea4b3 None admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:57.763212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 654/1305] 10.222.0.72 () {56 vars in 1116 bytes} [Mon May 16 18:38:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:38:57.769152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953515a-de75-43b2-803b-dcb947f283ba None admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:38:57.861819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953515a-de75-43b2-803b-dcb947f283ba None admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:38:57.893387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2995871-93a2-4449-8c8b-c03405e85426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:38:57.894028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995871-93a2-4449-8c8b-c03405e85426 None admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:38:57.894312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995871-93a2-4449-8c8b-c03405e85426 None admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:38:57.894673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995871-93a2-4449-8c8b-c03405e85426 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:38:57.895603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2995871-93a2-4449-8c8b-c03405e85426 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:38:57.896997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2995871-93a2-4449-8c8b-c03405e85426 None admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:38:57.914640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 652/1306] 10.222.0.72 () {60 vars in 1144 bytes} [Mon May 16 18:38:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:40:02.398518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a061c-c826-4031-94e2-58136a3d76c4 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:02.399461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a061c-c826-4031-94e2-58136a3d76c4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:02.400004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a061c-c826-4031-94e2-58136a3d76c4 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:02.401883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 655/1307] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:02.406979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8fd1-187e-415d-881d-b1469543a095 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:02.408211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8fd1-187e-415d-881d-b1469543a095 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:02.408729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8fd1-187e-415d-881d-b1469543a095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:02.483144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d41e8fd1-187e-415d-881d-b1469543a095 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:02.484758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d41e8fd1-187e-415d-881d-b1469543a095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:02.707008 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 653/1308] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:02.761357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b85c26-cc06-4796-97e9-c7d81a839c17 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:02.761641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b85c26-cc06-4796-97e9-c7d81a839c17 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:02.761924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b85c26-cc06-4796-97e9-c7d81a839c17 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:02.763448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 656/1309] 10.222.0.72 () {54 vars in 964 bytes} [Mon May 16 18:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:02.770804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb59ffc-3285-4ca7-8d92-6b5668f907ad None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:02.771089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb59ffc-3285-4ca7-8d92-6b5668f907ad None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:02.771544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb59ffc-3285-4ca7-8d92-6b5668f907ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:02.847291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-7cb59ffc-3285-4ca7-8d92-6b5668f907ad None None] MFA Rules not processed for user `c22a0fc8a3914f7fb3356a84827db326`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:02.848537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7cb59ffc-3285-4ca7-8d92-6b5668f907ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:02.926835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 654/1310] 10.222.0.72 () {58 vars in 1061 bytes} [Mon May 16 18:40:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:02.937018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b85c26-cc06-4796-97e9-c7d81a839c17 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:02.938739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c0b85c26-cc06-4796-97e9-c7d81a839c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:03.055334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b85c26-cc06-4796-97e9-c7d81a839c17 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:03.129867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adc655-56ab-45f3-81bf-fa4733353f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:03.130779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adc655-56ab-45f3-81bf-fa4733353f55 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:03.131232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adc655-56ab-45f3-81bf-fa4733353f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:03.131678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adc655-56ab-45f3-81bf-fa4733353f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:03.133593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e0adc655-56ab-45f3-81bf-fa4733353f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:03.244704 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adc655-56ab-45f3-81bf-fa4733353f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:03.246556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adc655-56ab-45f3-81bf-fa4733353f55 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:03.268755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 657/1311] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:05.781854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddfa18-86b1-4868-92ce-ec3bac16c7b9 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:05.782372 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddfa18-86b1-4868-92ce-ec3bac16c7b9 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:05.782372 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddfa18-86b1-4868-92ce-ec3bac16c7b9 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:05.783908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 655/1312] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:05.789310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9abf1-a9b0-41f2-849b-f811b7e447a1 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:05.789768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9abf1-a9b0-41f2-849b-f811b7e447a1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:05.789989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9abf1-a9b0-41f2-849b-f811b7e447a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:05.871695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2ca9abf1-a9b0-41f2-849b-f811b7e447a1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:05.872778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2ca9abf1-a9b0-41f2-849b-f811b7e447a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:05.966490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 658/1313] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:40:06.020955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c5ac-31d8-4e32-b1df-8b41e6bfc004 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:06.021239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c5ac-31d8-4e32-b1df-8b41e6bfc004 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:06.021516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c5ac-31d8-4e32-b1df-8b41e6bfc004 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:06.022891 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 656/1314] 10.222.0.72 () {54 vars in 964 bytes} [Mon May 16 18:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:06.029017 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615e6b-5c4f-413f-a2e1-1f37a14743e6 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:06.029303 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615e6b-5c4f-413f-a2e1-1f37a14743e6 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:06.029579 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615e6b-5c4f-413f-a2e1-1f37a14743e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:06.104874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-12615e6b-5c4f-413f-a2e1-1f37a14743e6 None None] MFA Rules not processed for user `c22a0fc8a3914f7fb3356a84827db326`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:06.105990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-12615e6b-5c4f-413f-a2e1-1f37a14743e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:06.177855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 659/1315] 10.222.0.72 () {58 vars in 1061 bytes} [Mon May 16 18:40:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:40:06.186729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76c5ac-31d8-4e32-b1df-8b41e6bfc004 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:06.188247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-6b76c5ac-31d8-4e32-b1df-8b41e6bfc004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:06.288097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76c5ac-31d8-4e32-b1df-8b41e6bfc004 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:06.365636 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cfd7a-df62-4dcc-a815-555d61468f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:06.366207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cfd7a-df62-4dcc-a815-555d61468f08 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:06.366493 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cfd7a-df62-4dcc-a815-555d61468f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:06.366767 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cfd7a-df62-4dcc-a815-555d61468f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:06.368442 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-8d1cfd7a-df62-4dcc-a815-555d61468f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:06.473663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cfd7a-df62-4dcc-a815-555d61468f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:06.475454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cfd7a-df62-4dcc-a815-555d61468f08 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:06.494084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 657/1316] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:09.354009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0dff2-95ab-4ec7-a880-734484441488 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:09.354594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0dff2-95ab-4ec7-a880-734484441488 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:09.354594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0dff2-95ab-4ec7-a880-734484441488 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:09.356063 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 660/1317] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:09.362148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a80f0-f34c-40c5-a750-1fc25714041f None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:09.362595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a80f0-f34c-40c5-a750-1fc25714041f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:09.362713 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a80f0-f34c-40c5-a750-1fc25714041f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:09.430087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-c11a80f0-f34c-40c5-a750-1fc25714041f None None] MFA Rules not processed for user `9736248d560340dba1575baeea8ca3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:09.431281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c11a80f0-f34c-40c5-a750-1fc25714041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:09.523911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 658/1318] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:09.562904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0dff2-95ab-4ec7-a880-734484441488 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:09.565135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-71f0dff2-95ab-4ec7-a880-734484441488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:09.667723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0dff2-95ab-4ec7-a880-734484441488 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:09.739810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356b585-e16a-4a21-b02e-d18061efa351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:09.740459 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356b585-e16a-4a21-b02e-d18061efa351 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:09.740733 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356b585-e16a-4a21-b02e-d18061efa351 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:09.741001 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356b585-e16a-4a21-b02e-d18061efa351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:09.742628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7356b585-e16a-4a21-b02e-d18061efa351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:09.845842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356b585-e16a-4a21-b02e-d18061efa351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:09.847285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356b585-e16a-4a21-b02e-d18061efa351 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:09.865497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 661/1319] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:12.793628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680df38-5dd4-4f2f-a4ae-5f79063f45b8 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:12.794221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680df38-5dd4-4f2f-a4ae-5f79063f45b8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:12.794221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680df38-5dd4-4f2f-a4ae-5f79063f45b8 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:12.795533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 659/1320] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:12.800790 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c172fd6-cd00-42b6-9751-2c83a02e7992 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:12.801224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c172fd6-cd00-42b6-9751-2c83a02e7992 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:12.801331 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c172fd6-cd00-42b6-9751-2c83a02e7992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:12.864719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2c172fd6-cd00-42b6-9751-2c83a02e7992 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:12.865906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2c172fd6-cd00-42b6-9751-2c83a02e7992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:12.958236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 662/1321] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:12.996965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680df38-5dd4-4f2f-a4ae-5f79063f45b8 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:12.998467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a680df38-5dd4-4f2f-a4ae-5f79063f45b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:13.098327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680df38-5dd4-4f2f-a4ae-5f79063f45b8 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:13.167057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4feac-e1fc-475f-8f85-417608273aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:13.167698 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4feac-e1fc-475f-8f85-417608273aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:13.168010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4feac-e1fc-475f-8f85-417608273aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:13.168286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4feac-e1fc-475f-8f85-417608273aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:13.169892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-53a4feac-e1fc-475f-8f85-417608273aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:13.289200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4feac-e1fc-475f-8f85-417608273aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:13.290635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4feac-e1fc-475f-8f85-417608273aa0 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:13.308911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 660/1322] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:16.256421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4840884-515a-4728-acb7-18d53241d8d1 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:16.256962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4840884-515a-4728-acb7-18d53241d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:16.256962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4840884-515a-4728-acb7-18d53241d8d1 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:16.258259 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 663/1323] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:16.263427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d014ca-aee5-48ff-b33a-cf2bfa92e138 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:16.263844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d014ca-aee5-48ff-b33a-cf2bfa92e138 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:16.264123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d014ca-aee5-48ff-b33a-cf2bfa92e138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:16.326964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-85d014ca-aee5-48ff-b33a-cf2bfa92e138 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:16.328174 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-85d014ca-aee5-48ff-b33a-cf2bfa92e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:16.421884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 661/1324] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:16.458211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4840884-515a-4728-acb7-18d53241d8d1 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:16.459822 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e4840884-515a-4728-acb7-18d53241d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:16.560563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4840884-515a-4728-acb7-18d53241d8d1 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:16.631881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac1360-14c9-48ab-80c3-eec7c9ec9419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:16.632537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac1360-14c9-48ab-80c3-eec7c9ec9419 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:16.632835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac1360-14c9-48ab-80c3-eec7c9ec9419 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:16.633097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac1360-14c9-48ab-80c3-eec7c9ec9419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:16.634737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-60ac1360-14c9-48ab-80c3-eec7c9ec9419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:16.743008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac1360-14c9-48ab-80c3-eec7c9ec9419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:16.744460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac1360-14c9-48ab-80c3-eec7c9ec9419 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:16.768084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 664/1325] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:19.058563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd8d7-c6cd-4c13-89f7-612f7164ecfd None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:19.059118 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd8d7-c6cd-4c13-89f7-612f7164ecfd None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:19.059210 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd8d7-c6cd-4c13-89f7-612f7164ecfd None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:19.061182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 662/1326] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:19.070310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a2282-7fbf-4f4b-99d7-520db494d004 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:19.070757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a2282-7fbf-4f4b-99d7-520db494d004 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:19.070872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a2282-7fbf-4f4b-99d7-520db494d004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:19.145180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-be3a2282-7fbf-4f4b-99d7-520db494d004 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:19.146925 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-be3a2282-7fbf-4f4b-99d7-520db494d004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:19.257158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 665/1327] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:19.292598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfd8d7-c6cd-4c13-89f7-612f7164ecfd None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:19.294093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-55dfd8d7-c6cd-4c13-89f7-612f7164ecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:19.396484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfd8d7-c6cd-4c13-89f7-612f7164ecfd None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:19.466459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b5648-9d34-4369-ab5d-93bef7ab48b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:19.467186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b5648-9d34-4369-ab5d-93bef7ab48b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:19.467467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b5648-9d34-4369-ab5d-93bef7ab48b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:19.467774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b5648-9d34-4369-ab5d-93bef7ab48b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:19.469401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1d4b5648-9d34-4369-ab5d-93bef7ab48b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:19.574769 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b5648-9d34-4369-ab5d-93bef7ab48b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:19.576286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b5648-9d34-4369-ab5d-93bef7ab48b4 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:19.594585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 663/1328] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:21.877588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ca52-4cfd-4df7-ab97-97d0e12f9335 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:21.878136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ca52-4cfd-4df7-ab97-97d0e12f9335 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:21.878253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ca52-4cfd-4df7-ab97-97d0e12f9335 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:21.879537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 666/1329] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:21.885082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37c993-5168-4c54-8782-1bcf42d04915 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:21.885524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37c993-5168-4c54-8782-1bcf42d04915 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:21.885773 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37c993-5168-4c54-8782-1bcf42d04915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:21.951900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-8e37c993-5168-4c54-8782-1bcf42d04915 None None] MFA Rules not processed for user `9736248d560340dba1575baeea8ca3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:21.953084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-8e37c993-5168-4c54-8782-1bcf42d04915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:22.046636 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 664/1330] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:22.083350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0ca52-4cfd-4df7-ab97-97d0e12f9335 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:22.084952 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5dc0ca52-4cfd-4df7-ab97-97d0e12f9335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:22.195524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0ca52-4cfd-4df7-ab97-97d0e12f9335 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:22.267142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe38592-f0c2-4885-a5ff-9ac72a0ec530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:22.267821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe38592-f0c2-4885-a5ff-9ac72a0ec530 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:22.268104 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe38592-f0c2-4885-a5ff-9ac72a0ec530 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:22.268377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe38592-f0c2-4885-a5ff-9ac72a0ec530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:22.270026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4fe38592-f0c2-4885-a5ff-9ac72a0ec530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:22.375695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe38592-f0c2-4885-a5ff-9ac72a0ec530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:22.377279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe38592-f0c2-4885-a5ff-9ac72a0ec530 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:22.395172 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 667/1331] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:24.948658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b4b3b-c2cf-4e70-a3c3-eed845ee5665 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:24.949135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b4b3b-c2cf-4e70-a3c3-eed845ee5665 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:24.949230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b4b3b-c2cf-4e70-a3c3-eed845ee5665 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:24.950588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 665/1332] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:24.955989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247594b3-e55d-40e0-bd44-aaff3b77a889 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:24.956434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247594b3-e55d-40e0-bd44-aaff3b77a889 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:24.956553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247594b3-e55d-40e0-bd44-aaff3b77a889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:25.020787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-247594b3-e55d-40e0-bd44-aaff3b77a889 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:25.021903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-247594b3-e55d-40e0-bd44-aaff3b77a889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:25.116226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 668/1333] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:25.150924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b4b3b-c2cf-4e70-a3c3-eed845ee5665 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:25.152472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b98b4b3b-c2cf-4e70-a3c3-eed845ee5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:25.257340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b4b3b-c2cf-4e70-a3c3-eed845ee5665 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:25.346014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0bab5-9f13-4610-bd8b-2259d8ac5fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:25.346676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0bab5-9f13-4610-bd8b-2259d8ac5fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:25.346959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0bab5-9f13-4610-bd8b-2259d8ac5fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:25.347245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0bab5-9f13-4610-bd8b-2259d8ac5fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:25.348981 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c8a0bab5-9f13-4610-bd8b-2259d8ac5fe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:25.459465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0bab5-9f13-4610-bd8b-2259d8ac5fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:25.460968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0bab5-9f13-4610-bd8b-2259d8ac5fe9 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:25.480005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 666/1334] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:27.765960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9b523-121c-48e0-865e-5977b79edbf8 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:27.767031 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9b523-121c-48e0-865e-5977b79edbf8 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:27.767031 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9b523-121c-48e0-865e-5977b79edbf8 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:27.768558 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 669/1335] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:27.773689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4f30-29a7-459a-b56d-fbbd67586fcf None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:27.774112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4f30-29a7-459a-b56d-fbbd67586fcf None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:27.774245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4f30-29a7-459a-b56d-fbbd67586fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:27.836600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4c5d4f30-29a7-459a-b56d-fbbd67586fcf None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:27.837786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4c5d4f30-29a7-459a-b56d-fbbd67586fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:27.943337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 667/1336] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:27.982752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9b523-121c-48e0-865e-5977b79edbf8 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:27.984358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b4e9b523-121c-48e0-865e-5977b79edbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:28.089579 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9b523-121c-48e0-865e-5977b79edbf8 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:28.164282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e85369-dea8-44f1-bdda-94e598fa4b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:28.164939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e85369-dea8-44f1-bdda-94e598fa4b80 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:28.165218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e85369-dea8-44f1-bdda-94e598fa4b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:28.165490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e85369-dea8-44f1-bdda-94e598fa4b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:28.167135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-64e85369-dea8-44f1-bdda-94e598fa4b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:28.275055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e85369-dea8-44f1-bdda-94e598fa4b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:28.276538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e85369-dea8-44f1-bdda-94e598fa4b80 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:28.294597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 670/1337] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:30.819911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb61a-84f5-42fd-a528-94251c7f67d8 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:30.820431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb61a-84f5-42fd-a528-94251c7f67d8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:30.820431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb61a-84f5-42fd-a528-94251c7f67d8 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:30.821743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 668/1338] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:30.826819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76b282-06d9-4f33-ae82-8763ab01fa73 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:30.827276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76b282-06d9-4f33-ae82-8763ab01fa73 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:30.827432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76b282-06d9-4f33-ae82-8763ab01fa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:30.889755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-1f76b282-06d9-4f33-ae82-8763ab01fa73 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:30.890932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1f76b282-06d9-4f33-ae82-8763ab01fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:30.998347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 671/1339] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:31.034784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fb61a-84f5-42fd-a528-94251c7f67d8 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:31.036367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-439fb61a-84f5-42fd-a528-94251c7f67d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:31.135878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fb61a-84f5-42fd-a528-94251c7f67d8 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:31.206663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75e512-7817-4891-85c9-8eb3354ff279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:31.207301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75e512-7817-4891-85c9-8eb3354ff279 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:31.207581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75e512-7817-4891-85c9-8eb3354ff279 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:31.207882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75e512-7817-4891-85c9-8eb3354ff279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:31.209488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ec75e512-7817-4891-85c9-8eb3354ff279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:31.310778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75e512-7817-4891-85c9-8eb3354ff279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:31.312246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75e512-7817-4891-85c9-8eb3354ff279 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:31.333382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 669/1340] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:35.515969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcec748-ecb2-4433-af60-3ef091783e9e None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:35.516590 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcec748-ecb2-4433-af60-3ef091783e9e None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:35.516590 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcec748-ecb2-4433-af60-3ef091783e9e None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:35.517778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 672/1341] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:35.523198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c65297-02da-409e-b023-f6e9e8d82ec0 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:35.523646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c65297-02da-409e-b023-f6e9e8d82ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:35.523780 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c65297-02da-409e-b023-f6e9e8d82ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:35.591668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d2c65297-02da-409e-b023-f6e9e8d82ec0 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:35.592887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d2c65297-02da-409e-b023-f6e9e8d82ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:35.697108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 670/1342] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:40:35.736098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcec748-ecb2-4433-af60-3ef091783e9e None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:35.738267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8dcec748-ecb2-4433-af60-3ef091783e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:35.832627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcec748-ecb2-4433-af60-3ef091783e9e None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:35.836230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e364a7-9b74-4090-b0e3-98a51e1fcca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:35.836904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e364a7-9b74-4090-b0e3-98a51e1fcca7 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:35.837182 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e364a7-9b74-4090-b0e3-98a51e1fcca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:35.837455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e364a7-9b74-4090-b0e3-98a51e1fcca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:35.847018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e364a7-9b74-4090-b0e3-98a51e1fcca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:35.848479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e364a7-9b74-4090-b0e3-98a51e1fcca7 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:35.857628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 673/1343] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:38.769974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50b5a0-ed7d-433c-a37f-96f57519b91f None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:38.770524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50b5a0-ed7d-433c-a37f-96f57519b91f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:38.770524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50b5a0-ed7d-433c-a37f-96f57519b91f None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:38.771970 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 671/1344] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:38.777327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a98ae-694d-4407-b9c7-afaa9ebc9e50 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:38.777806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a98ae-694d-4407-b9c7-afaa9ebc9e50 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:38.777913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a98ae-694d-4407-b9c7-afaa9ebc9e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:38.805168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-340a98ae-694d-4407-b9c7-afaa9ebc9e50 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:38.806353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-340a98ae-694d-4407-b9c7-afaa9ebc9e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:38.883121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 674/1345] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:40:38.919609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50b5a0-ed7d-433c-a37f-96f57519b91f None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:38.930886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50b5a0-ed7d-433c-a37f-96f57519b91f None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:38.934926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85924cd-fc9b-4f24-9183-51e93289cf88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:38.935644 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85924cd-fc9b-4f24-9183-51e93289cf88 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:38.936150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85924cd-fc9b-4f24-9183-51e93289cf88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:38.936518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85924cd-fc9b-4f24-9183-51e93289cf88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:38.946668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85924cd-fc9b-4f24-9183-51e93289cf88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:38.948147 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85924cd-fc9b-4f24-9183-51e93289cf88 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:38.957530 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 672/1346] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:43.092172 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdfcca-a218-4693-a1da-ee9f9d11b216 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:43.092676 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdfcca-a218-4693-a1da-ee9f9d11b216 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:43.092788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdfcca-a218-4693-a1da-ee9f9d11b216 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:43.094678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 675/1347] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:43.100359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648028-f74c-4fb8-98ab-2a7d97efb086 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:43.100815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648028-f74c-4fb8-98ab-2a7d97efb086 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:43.100942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648028-f74c-4fb8-98ab-2a7d97efb086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:43.120444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f1648028-f74c-4fb8-98ab-2a7d97efb086 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:43.121649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f1648028-f74c-4fb8-98ab-2a7d97efb086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:43.130360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 673/1348] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:43.168138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdfcca-a218-4693-a1da-ee9f9d11b216 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:43.180093 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdfcca-a218-4693-a1da-ee9f9d11b216 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:43.183651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe3fdf-bc44-472b-a159-6861395aceb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:43.184290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe3fdf-bc44-472b-a159-6861395aceb4 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:43.184574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe3fdf-bc44-472b-a159-6861395aceb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:43.184853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe3fdf-bc44-472b-a159-6861395aceb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:43.194655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe3fdf-bc44-472b-a159-6861395aceb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:43.196132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe3fdf-bc44-472b-a159-6861395aceb4 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:43.205710 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 676/1349] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:40:48.593561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9c0ba-346b-4643-960e-6f26eb5e486f None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:48.594535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9c0ba-346b-4643-960e-6f26eb5e486f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:48.594925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9c0ba-346b-4643-960e-6f26eb5e486f None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:48.596829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 674/1350] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:48.602204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61db710-6ff1-4533-aeca-a79689f76935 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:48.603055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61db710-6ff1-4533-aeca-a79689f76935 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:48.603538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61db710-6ff1-4533-aeca-a79689f76935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:48.673714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c61db710-6ff1-4533-aeca-a79689f76935 None None] MFA Rules not processed for user `443fd569cd1b4f6db86d575ed669e26a`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:48.675437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c61db710-6ff1-4533-aeca-a79689f76935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:48.755348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 677/1351] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:40:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:53.116447 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509d80-7f10-4f72-9972-f6ba2a06c989 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:53.116966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509d80-7f10-4f72-9972-f6ba2a06c989 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:53.116966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77509d80-7f10-4f72-9972-f6ba2a06c989 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:53.118463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 675/1352] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:53.123734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3eced-e6c0-48b0-9b90-3628bc018c18 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:53.124190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3eced-e6c0-48b0-9b90-3628bc018c18 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:53.126461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3eced-e6c0-48b0-9b90-3628bc018c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:53.143503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d9e3eced-e6c0-48b0-9b90-3628bc018c18 None None] MFA Rules not processed for user `443fd569cd1b4f6db86d575ed669e26a`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:53.144865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d9e3eced-e6c0-48b0-9b90-3628bc018c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:53.153851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 678/1353] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:40:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:54.882106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d09923-517c-49b2-bc3d-d82c0626b0c1 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:54.882675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d09923-517c-49b2-bc3d-d82c0626b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:54.882675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d09923-517c-49b2-bc3d-d82c0626b0c1 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:54.884904 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 676/1354] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:54.895896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ed693-a349-4ce7-ac7b-26e28c06a782 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:54.896407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ed693-a349-4ce7-ac7b-26e28c06a782 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:54.896488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ed693-a349-4ce7-ac7b-26e28c06a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:54.914894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-056ed693-a349-4ce7-ac7b-26e28c06a782 None None] MFA Rules not processed for user `443fd569cd1b4f6db86d575ed669e26a`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:54.916117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-056ed693-a349-4ce7-ac7b-26e28c06a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:54.928435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 679/1355] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:40:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:40:58.842643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab2d0a-5841-427d-8552-f739ef28c2ec None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:58.843180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab2d0a-5841-427d-8552-f739ef28c2ec None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:58.843296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab2d0a-5841-427d-8552-f739ef28c2ec None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:58.845126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 677/1356] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:58.850351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79add-fe1c-41f1-a565-7a3c9e53a63b None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:58.850756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79add-fe1c-41f1-a565-7a3c9e53a63b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:58.850906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79add-fe1c-41f1-a565-7a3c9e53a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:58.869603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d7b79add-fe1c-41f1-a565-7a3c9e53a63b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:58.870775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d7b79add-fe1c-41f1-a565-7a3c9e53a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:58.879340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 680/1357] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:40:58.931248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab4ee-730a-4dea-b36d-ca0aa57ba197 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:58.931248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab4ee-730a-4dea-b36d-ca0aa57ba197 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:58.931248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ab4ee-730a-4dea-b36d-ca0aa57ba197 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:58.931248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 678/1358] 10.222.0.72 () {54 vars in 961 bytes} [Mon May 16 18:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:40:58.936679 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e68ab-9a6f-4af9-9fad-b234886fba84 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:58.937030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e68ab-9a6f-4af9-9fad-b234886fba84 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:58.938844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e68ab-9a6f-4af9-9fad-b234886fba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:58.988397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-fb8e68ab-9a6f-4af9-9fad-b234886fba84 None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:40:58.989563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-fb8e68ab-9a6f-4af9-9fad-b234886fba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:40:59.080394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 681/1359] 10.222.0.72 () {58 vars in 1058 bytes} [Mon May 16 18:40:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:40:59.089274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ab4ee-730a-4dea-b36d-ca0aa57ba197 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:40:59.106213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ab4ee-730a-4dea-b36d-ca0aa57ba197 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:40:59.113255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b86ff0-7a2d-4454-ad30-d7ee13b64728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:40:59.114063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86ff0-7a2d-4454-ad30-d7ee13b64728 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:40:59.114508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86ff0-7a2d-4454-ad30-d7ee13b64728 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:40:59.115220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86ff0-7a2d-4454-ad30-d7ee13b64728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:40:59.124015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b86ff0-7a2d-4454-ad30-d7ee13b64728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:40:59.126056 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b86ff0-7a2d-4454-ad30-d7ee13b64728 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:40:59.135988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 679/1360] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:41:01.632295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df868e7f-a4b0-4ea5-aba7-158118881c40 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:01.634041 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df868e7f-a4b0-4ea5-aba7-158118881c40 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:01.634675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df868e7f-a4b0-4ea5-aba7-158118881c40 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:01.637171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 682/1361] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:01.642242 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf212faf-ce90-4244-b49a-1f493308163e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:01.642711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf212faf-ce90-4244-b49a-1f493308163e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:01.642820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf212faf-ce90-4244-b49a-1f493308163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:01.661915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-cf212faf-ce90-4244-b49a-1f493308163e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:01.663037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-cf212faf-ce90-4244-b49a-1f493308163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:01.671076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 680/1362] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:41:01.717192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df868e7f-a4b0-4ea5-aba7-158118881c40 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:01.731370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df868e7f-a4b0-4ea5-aba7-158118881c40 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:01.740231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99f47f-1c88-4e52-8db2-ef76f17f1536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:01.740891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99f47f-1c88-4e52-8db2-ef76f17f1536 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:01.741173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99f47f-1c88-4e52-8db2-ef76f17f1536 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:01.741450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99f47f-1c88-4e52-8db2-ef76f17f1536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:01.751438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99f47f-1c88-4e52-8db2-ef76f17f1536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:01.753288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99f47f-1c88-4e52-8db2-ef76f17f1536 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:01.763938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 683/1363] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:04.342364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3ff1-3aad-4c32-8d7d-fa68ad51f068 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:04.342924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3ff1-3aad-4c32-8d7d-fa68ad51f068 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:04.342924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3ff1-3aad-4c32-8d7d-fa68ad51f068 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:04.345218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 681/1364] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:04.350718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b40cb-f752-437e-8ee1-662760d1541f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:04.351185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b40cb-f752-437e-8ee1-662760d1541f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:04.351295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b40cb-f752-437e-8ee1-662760d1541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:04.369504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-705b40cb-f752-437e-8ee1-662760d1541f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:04.370687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-705b40cb-f752-437e-8ee1-662760d1541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:04.378619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 684/1365] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:04.427208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522fcd0-3764-4dda-b606-08785b08d7e1 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:04.427513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522fcd0-3764-4dda-b606-08785b08d7e1 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:04.427970 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522fcd0-3764-4dda-b606-08785b08d7e1 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:04.429864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 682/1366] 10.222.0.72 () {54 vars in 961 bytes} [Mon May 16 18:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:04.435081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf86d-30a2-4386-8ced-33d6398afd47 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:04.435622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf86d-30a2-4386-8ced-33d6398afd47 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:04.436130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf86d-30a2-4386-8ced-33d6398afd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:04.456504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-dccaf86d-30a2-4386-8ced-33d6398afd47 None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:04.458032 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-dccaf86d-30a2-4386-8ced-33d6398afd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:04.468114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 685/1367] 10.222.0.72 () {58 vars in 1058 bytes} [Mon May 16 18:41:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:04.476065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522fcd0-3764-4dda-b606-08785b08d7e1 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:04.490708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522fcd0-3764-4dda-b606-08785b08d7e1 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:04.496089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ccd2-d982-4923-9e10-09d89f91ec16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:04.496732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ccd2-d982-4923-9e10-09d89f91ec16 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:04.497016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ccd2-d982-4923-9e10-09d89f91ec16 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:04.497296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ccd2-d982-4923-9e10-09d89f91ec16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:04.506266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ccd2-d982-4923-9e10-09d89f91ec16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:04.507880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ccd2-d982-4923-9e10-09d89f91ec16 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:04.517294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 683/1368] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:06.825077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df02fa-e641-48b4-8548-21f463bb7903 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:06.825673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df02fa-e641-48b4-8548-21f463bb7903 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:06.825951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df02fa-e641-48b4-8548-21f463bb7903 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:06.827620 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 686/1369] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:06.833668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778e235-ef53-4bda-ade8-73f0d4a6a86c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:06.834151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778e235-ef53-4bda-ade8-73f0d4a6a86c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:06.834425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778e235-ef53-4bda-ade8-73f0d4a6a86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:06.853506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1778e235-ef53-4bda-ade8-73f0d4a6a86c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:06.854837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1778e235-ef53-4bda-ade8-73f0d4a6a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:06.863094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 684/1370] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:06.906660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df02fa-e641-48b4-8548-21f463bb7903 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:06.924627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df02fa-e641-48b4-8548-21f463bb7903 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:06.934085 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838c15e-f68a-4ad6-b27c-c2bde1713313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:06.934366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838c15e-f68a-4ad6-b27c-c2bde1713313 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:06.934903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838c15e-f68a-4ad6-b27c-c2bde1713313 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:06.935249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838c15e-f68a-4ad6-b27c-c2bde1713313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:06.944462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838c15e-f68a-4ad6-b27c-c2bde1713313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:06.946122 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838c15e-f68a-4ad6-b27c-c2bde1713313 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:06.956607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 687/1371] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:07.244815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1feae-b723-4adb-8b4a-0888c57f8e7d None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:07.245364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1feae-b723-4adb-8b4a-0888c57f8e7d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:07.245837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1feae-b723-4adb-8b4a-0888c57f8e7d None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:07.247222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 685/1372] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:07.253000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10a41a-f4a4-4f6a-ba82-7b8a604515e7 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:07.253362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10a41a-f4a4-4f6a-ba82-7b8a604515e7 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:07.253727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10a41a-f4a4-4f6a-ba82-7b8a604515e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:07.272588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-6e10a41a-f4a4-4f6a-ba82-7b8a604515e7 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:07.273857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-6e10a41a-f4a4-4f6a-ba82-7b8a604515e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:07.282407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 688/1373] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:07.608122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc284d-5e4e-491e-8f7b-dd52545cffc4 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:07.610882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc284d-5e4e-491e-8f7b-dd52545cffc4 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:07.610882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc284d-5e4e-491e-8f7b-dd52545cffc4 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:07.610882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 686/1374] 10.222.0.72 () {54 vars in 963 bytes} [Mon May 16 18:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:07.616512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5108-8618-4a45-abcd-e500183bb8c7 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:07.616871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5108-8618-4a45-abcd-e500183bb8c7 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:07.617220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5108-8618-4a45-abcd-e500183bb8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:07.665032 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-bafa5108-8618-4a45-abcd-e500183bb8c7 None None] MFA Rules not processed for user `eb06ac74276c4238b178a2467013348c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:07.666212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-bafa5108-8618-4a45-abcd-e500183bb8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:07.726299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 689/1375] 10.222.0.72 () {58 vars in 1060 bytes} [Mon May 16 18:41:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:07.733649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc284d-5e4e-491e-8f7b-dd52545cffc4 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:07.744887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc284d-5e4e-491e-8f7b-dd52545cffc4 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:07.748344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb99d9d-0e89-4986-805c-bf68240c57e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:07.749210 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb99d9d-0e89-4986-805c-bf68240c57e8 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:07.749855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb99d9d-0e89-4986-805c-bf68240c57e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:07.750136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb99d9d-0e89-4986-805c-bf68240c57e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:07.759533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb99d9d-0e89-4986-805c-bf68240c57e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:07.761233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb99d9d-0e89-4986-805c-bf68240c57e8 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:07.771188 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 687/1376] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:09.252972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540c41b-fc6f-4d42-9f86-df1c8650fbe4 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:09.253503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540c41b-fc6f-4d42-9f86-df1c8650fbe4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:09.253503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540c41b-fc6f-4d42-9f86-df1c8650fbe4 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:09.254868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 690/1377] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:09.260416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb550659-57dc-408d-be9d-91563cab4d85 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:09.260956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb550659-57dc-408d-be9d-91563cab4d85 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:09.261063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb550659-57dc-408d-be9d-91563cab4d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:09.279576 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-bb550659-57dc-408d-be9d-91563cab4d85 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:09.281369 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-bb550659-57dc-408d-be9d-91563cab4d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:09.289458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 688/1378] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:41:09.335349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540c41b-fc6f-4d42-9f86-df1c8650fbe4 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:09.350825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540c41b-fc6f-4d42-9f86-df1c8650fbe4 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:09.356437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61205d-f35b-4bae-8065-8357d3404486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:09.357109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61205d-f35b-4bae-8065-8357d3404486 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:09.357393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61205d-f35b-4bae-8065-8357d3404486 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:09.357668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61205d-f35b-4bae-8065-8357d3404486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:09.367628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61205d-f35b-4bae-8065-8357d3404486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:09.369280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61205d-f35b-4bae-8065-8357d3404486 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:09.380205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 691/1379] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:11.667967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47a0b-fede-4ad4-85de-49c29b2a28d0 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:11.668885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47a0b-fede-4ad4-85de-49c29b2a28d0 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:11.669167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47a0b-fede-4ad4-85de-49c29b2a28d0 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:11.670541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 689/1380] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:11.676624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae62d6-062f-4642-a92a-e3b35e47f352 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:11.677067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae62d6-062f-4642-a92a-e3b35e47f352 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:11.677172 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae62d6-062f-4642-a92a-e3b35e47f352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:11.694977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-aeae62d6-062f-4642-a92a-e3b35e47f352 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:11.696423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-aeae62d6-062f-4642-a92a-e3b35e47f352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:11.708316 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 692/1381] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:11.748772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa47a0b-fede-4ad4-85de-49c29b2a28d0 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:11.763047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa47a0b-fede-4ad4-85de-49c29b2a28d0 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:11.768771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab66f7-1842-4360-8678-4b1a8bfc2d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:11.769567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab66f7-1842-4360-8678-4b1a8bfc2d11 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:11.769950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab66f7-1842-4360-8678-4b1a8bfc2d11 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:11.770335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab66f7-1842-4360-8678-4b1a8bfc2d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:11.778828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab66f7-1842-4360-8678-4b1a8bfc2d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:11.780564 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab66f7-1842-4360-8678-4b1a8bfc2d11 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:11.790953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 690/1382] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:14.083739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a123866-d09a-4f9b-b969-37662164e06c None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:14.084163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a123866-d09a-4f9b-b969-37662164e06c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:14.084348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a123866-d09a-4f9b-b969-37662164e06c None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:14.085719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 693/1383] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:14.091108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2d7c5-7355-42dc-8107-6d838755f351 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:14.091816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2d7c5-7355-42dc-8107-6d838755f351 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:14.091971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2d7c5-7355-42dc-8107-6d838755f351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:14.110699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d2f2d7c5-7355-42dc-8107-6d838755f351 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:14.111836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d2f2d7c5-7355-42dc-8107-6d838755f351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:14.121906 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 691/1384] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:14.161740 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a123866-d09a-4f9b-b969-37662164e06c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:14.178224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a123866-d09a-4f9b-b969-37662164e06c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:14.183788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d6ad2-ba24-485f-a24b-e578dd0b3c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:14.184439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d6ad2-ba24-485f-a24b-e578dd0b3c9a service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:14.184716 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d6ad2-ba24-485f-a24b-e578dd0b3c9a service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:14.184993 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d6ad2-ba24-485f-a24b-e578dd0b3c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:14.194161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d6ad2-ba24-485f-a24b-e578dd0b3c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:14.195991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d6ad2-ba24-485f-a24b-e578dd0b3c9a service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:14.205805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 694/1385] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:16.477244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668f5b-24be-48e2-ae15-81acaedc1ef9 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:16.477815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668f5b-24be-48e2-ae15-81acaedc1ef9 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:16.477815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668f5b-24be-48e2-ae15-81acaedc1ef9 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:16.479148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 692/1386] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:41:16.484651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611431c-a48c-4155-aa07-3f735171e8d2 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:16.485071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611431c-a48c-4155-aa07-3f735171e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:16.485200 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611431c-a48c-4155-aa07-3f735171e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:16.504255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-3611431c-a48c-4155-aa07-3f735171e8d2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:16.505544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3611431c-a48c-4155-aa07-3f735171e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:16.513730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 695/1387] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:16.557925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec668f5b-24be-48e2-ae15-81acaedc1ef9 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:16.572245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec668f5b-24be-48e2-ae15-81acaedc1ef9 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:16.578551 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccaa7e-5574-4cbd-b7fd-efec57d4e513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:16.579044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaa7e-5574-4cbd-b7fd-efec57d4e513 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:16.579328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaa7e-5574-4cbd-b7fd-efec57d4e513 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:16.579600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaa7e-5574-4cbd-b7fd-efec57d4e513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:16.587694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccaa7e-5574-4cbd-b7fd-efec57d4e513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:16.589280 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccaa7e-5574-4cbd-b7fd-efec57d4e513 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:16.598939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 693/1388] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:18.864408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eb466-34a5-4ea2-ac02-57ae998a1655 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:18.865116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eb466-34a5-4ea2-ac02-57ae998a1655 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:18.865116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eb466-34a5-4ea2-ac02-57ae998a1655 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:18.866335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 696/1389] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:18.871907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4ec1f-df01-4f93-95bc-c4d35b3b5978 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:18.872392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4ec1f-df01-4f93-95bc-c4d35b3b5978 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:18.872545 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4ec1f-df01-4f93-95bc-c4d35b3b5978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:18.891256 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-37c4ec1f-df01-4f93-95bc-c4d35b3b5978 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:18.892475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-37c4ec1f-df01-4f93-95bc-c4d35b3b5978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:18.900710 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 694/1390] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:18.946110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eb466-34a5-4ea2-ac02-57ae998a1655 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:18.960809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eb466-34a5-4ea2-ac02-57ae998a1655 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:18.966646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f74701-a8e1-4f6c-92f0-4d95bead2a13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:18.967287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74701-a8e1-4f6c-92f0-4d95bead2a13 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:18.967566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74701-a8e1-4f6c-92f0-4d95bead2a13 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:18.967882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74701-a8e1-4f6c-92f0-4d95bead2a13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:18.976195 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f74701-a8e1-4f6c-92f0-4d95bead2a13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:18.977771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f74701-a8e1-4f6c-92f0-4d95bead2a13 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:18.987993 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 697/1391] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:21.240014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ba9c-c53c-45d8-85ff-48968b8841bc None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:21.240553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ba9c-c53c-45d8-85ff-48968b8841bc None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:21.240711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ba9c-c53c-45d8-85ff-48968b8841bc None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:21.242542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 695/1392] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:21.247875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6c531-4540-49df-8f82-f3ef8f350147 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:21.248288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6c531-4540-49df-8f82-f3ef8f350147 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:21.248457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6c531-4540-49df-8f82-f3ef8f350147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:21.267507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-09d6c531-4540-49df-8f82-f3ef8f350147 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:21.268737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-09d6c531-4540-49df-8f82-f3ef8f350147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:21.276696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 698/1393] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:21.323512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765ba9c-c53c-45d8-85ff-48968b8841bc None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:21.341984 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765ba9c-c53c-45d8-85ff-48968b8841bc None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:21.348971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e0d9b-d13b-420e-a576-3da84f3e8f60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:21.349989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0d9b-d13b-420e-a576-3da84f3e8f60 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:21.350355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0d9b-d13b-420e-a576-3da84f3e8f60 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:21.350699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0d9b-d13b-420e-a576-3da84f3e8f60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:21.361132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e0d9b-d13b-420e-a576-3da84f3e8f60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:21.363159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e0d9b-d13b-420e-a576-3da84f3e8f60 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:21.375919 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 696/1394] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:23.603149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ac27e-ff1d-43e8-a5c9-9d1a0b583830 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:23.603860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ac27e-ff1d-43e8-a5c9-9d1a0b583830 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:23.603860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ac27e-ff1d-43e8-a5c9-9d1a0b583830 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:23.605223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 699/1395] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:23.611081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340f5dc-c6d9-4bec-8881-ea764f6d7289 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:23.611547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340f5dc-c6d9-4bec-8881-ea764f6d7289 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:23.611661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340f5dc-c6d9-4bec-8881-ea764f6d7289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:23.628956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-6340f5dc-c6d9-4bec-8881-ea764f6d7289 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:23.630135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-6340f5dc-c6d9-4bec-8881-ea764f6d7289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:23.638045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 697/1396] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:23.683294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ac27e-ff1d-43e8-a5c9-9d1a0b583830 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:23.697680 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ac27e-ff1d-43e8-a5c9-9d1a0b583830 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:23.703110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc33f6-098d-46cf-baab-57bb8b8950c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:23.703795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc33f6-098d-46cf-baab-57bb8b8950c0 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:23.704079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc33f6-098d-46cf-baab-57bb8b8950c0 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:23.704353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc33f6-098d-46cf-baab-57bb8b8950c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:23.712687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc33f6-098d-46cf-baab-57bb8b8950c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:23.714258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc33f6-098d-46cf-baab-57bb8b8950c0 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:23.724741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 700/1397] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:23.843297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56eea8-294c-433b-b592-4d24086d9081 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:23.843570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56eea8-294c-433b-b592-4d24086d9081 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:23.843843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56eea8-294c-433b-b592-4d24086d9081 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:23.845261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 698/1398] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:23.851366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950e371-7f07-4a4c-878e-3a21defc064f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:23.851657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950e371-7f07-4a4c-878e-3a21defc064f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:23.851994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950e371-7f07-4a4c-878e-3a21defc064f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:23.871115 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-5950e371-7f07-4a4c-878e-3a21defc064f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:23.872387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5950e371-7f07-4a4c-878e-3a21defc064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:23.880611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 701/1399] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:23.938506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2edebd-0233-4001-8e2f-ffe533aa2f8f None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:23.938799 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2edebd-0233-4001-8e2f-ffe533aa2f8f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:23.939079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2edebd-0233-4001-8e2f-ffe533aa2f8f None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:23.940526 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 699/1400] 10.222.0.72 () {54 vars in 962 bytes} [Mon May 16 18:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:23.945966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461db908-249c-48f2-8302-7da1f70297c3 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:23.946333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461db908-249c-48f2-8302-7da1f70297c3 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:23.946665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461db908-249c-48f2-8302-7da1f70297c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:24.005384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-461db908-249c-48f2-8302-7da1f70297c3 None None] MFA Rules not processed for user `6f0e623c10804239a076fc6cde9b198d`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:24.006584 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-461db908-249c-48f2-8302-7da1f70297c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:24.064713 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 702/1401] 10.222.0.72 () {58 vars in 1059 bytes} [Mon May 16 18:41:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:24.072082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2edebd-0233-4001-8e2f-ffe533aa2f8f None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:24.083041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2edebd-0233-4001-8e2f-ffe533aa2f8f None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:24.087239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f140102-b51f-4d7f-a09f-64fcef9bb522 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0e623c10804239a076fc6cde9b198d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:24.087982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f140102-b51f-4d7f-a09f-64fcef9bb522 service glance] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:24.088334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f140102-b51f-4d7f-a09f-64fcef9bb522 service glance] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:24.088791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f140102-b51f-4d7f-a09f-64fcef9bb522 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:24.098734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f140102-b51f-4d7f-a09f-64fcef9bb522 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:24.100196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f140102-b51f-4d7f-a09f-64fcef9bb522 service glance] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:24.109511 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 700/1402] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:24.552925 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02951-5166-4f78-b1e2-df7f65fa3b0d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:24.553271 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02951-5166-4f78-b1e2-df7f65fa3b0d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:24.553555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac02951-5166-4f78-b1e2-df7f65fa3b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:24.603821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2ac02951-5166-4f78-b1e2-df7f65fa3b0d None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:24.605801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2ac02951-5166-4f78-b1e2-df7f65fa3b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:24.669411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 703/1403] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:41:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:24.715449 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b16271-02eb-4279-9a17-eacd806149d9 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:24.715972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b16271-02eb-4279-9a17-eacd806149d9 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:24.716172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b16271-02eb-4279-9a17-eacd806149d9 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:24.717832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 701/1404] 10.222.0.72 () {54 vars in 942 bytes} [Mon May 16 18:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:24.724647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96c47-47c7-43bf-a974-a4bf6be93686 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:24.724880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96c47-47c7-43bf-a974-a4bf6be93686 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:24.725161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c96c47-47c7-43bf-a974-a4bf6be93686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:24.772075 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-96c96c47-47c7-43bf-a974-a4bf6be93686 None None] MFA Rules not processed for user `55231d7b40cb4479b9a6580a0f0b7cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:24.773297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-96c96c47-47c7-43bf-a974-a4bf6be93686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:24.842467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 704/1405] 10.222.0.72 () {58 vars in 1039 bytes} [Mon May 16 18:41:24 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:41:24.851944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b16271-02eb-4279-9a17-eacd806149d9 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:24.865441 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b16271-02eb-4279-9a17-eacd806149d9 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:24.870296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270924ae-a9d0-4fc9-b4e6-49bf3168bfc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:24.870936 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270924ae-a9d0-4fc9-b4e6-49bf3168bfc7 service swift] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:24.871221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270924ae-a9d0-4fc9-b4e6-49bf3168bfc7 service swift] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:24.871496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270924ae-a9d0-4fc9-b4e6-49bf3168bfc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:24.880036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270924ae-a9d0-4fc9-b4e6-49bf3168bfc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:24.881613 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270924ae-a9d0-4fc9-b4e6-49bf3168bfc7 service swift] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:24.889765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 702/1406] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:41:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:41:26.029473 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc5bb-d35c-49aa-8d02-16dc8bbbb20f None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:26.030016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc5bb-d35c-49aa-8d02-16dc8bbbb20f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:26.030016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc5bb-d35c-49aa-8d02-16dc8bbbb20f None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:26.032109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 705/1407] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:26.037572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2e5d4-281d-4696-afeb-5a834dd471d6 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:26.038016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2e5d4-281d-4696-afeb-5a834dd471d6 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:26.038147 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2e5d4-281d-4696-afeb-5a834dd471d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:26.056821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-14b2e5d4-281d-4696-afeb-5a834dd471d6 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:26.058012 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-14b2e5d4-281d-4696-afeb-5a834dd471d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:26.068755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 703/1408] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:26.111030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fc5bb-d35c-49aa-8d02-16dc8bbbb20f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:26.125606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fc5bb-d35c-49aa-8d02-16dc8bbbb20f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:26.130983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806a754-40b4-4c79-bb9d-0f27ba04132a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:26.131625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806a754-40b4-4c79-bb9d-0f27ba04132a service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:26.131952 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806a754-40b4-4c79-bb9d-0f27ba04132a service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:26.132220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806a754-40b4-4c79-bb9d-0f27ba04132a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:26.141495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806a754-40b4-4c79-bb9d-0f27ba04132a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:26.144499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806a754-40b4-4c79-bb9d-0f27ba04132a service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:26.152828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 706/1409] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:41:48.421632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3632b1-8eee-4dab-93c1-ede6a393ee11 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:48.422285 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3632b1-8eee-4dab-93c1-ede6a393ee11 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:48.422285 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3632b1-8eee-4dab-93c1-ede6a393ee11 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:48.423578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 704/1410] 10.222.0.72 () {54 vars in 918 bytes} [Mon May 16 18:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:48.429308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3767550-ff69-4705-a3e7-c0daa513d2c9 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:48.429783 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3767550-ff69-4705-a3e7-c0daa513d2c9 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:48.429892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3767550-ff69-4705-a3e7-c0daa513d2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:48.449330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d3767550-ff69-4705-a3e7-c0daa513d2c9 None None] MFA Rules not processed for user `443fd569cd1b4f6db86d575ed669e26a`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:48.453609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d3767550-ff69-4705-a3e7-c0daa513d2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:48.462538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 707/1411] 10.222.0.72 () {58 vars in 1015 bytes} [Mon May 16 18:41:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:41:48.477454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63879e-40c3-434e-95af-4e8d77708f0c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:48.477754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63879e-40c3-434e-95af-4e8d77708f0c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:48.478038 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63879e-40c3-434e-95af-4e8d77708f0c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:48.479538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 705/1412] 10.222.0.72 () {54 vars in 918 bytes} [Mon May 16 18:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:48.485362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e3dc-8525-4e66-bda3-79efd6e682a9 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:48.485651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e3dc-8525-4e66-bda3-79efd6e682a9 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:48.485934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e3dc-8525-4e66-bda3-79efd6e682a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:48.504586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-bc28e3dc-8525-4e66-bda3-79efd6e682a9 None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:48.505779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-bc28e3dc-8525-4e66-bda3-79efd6e682a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:48.515126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 708/1413] 10.222.0.72 () {58 vars in 1015 bytes} [Mon May 16 18:41:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:51.217595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef036-f279-409f-95f6-2804716b0031 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:51.218143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef036-f279-409f-95f6-2804716b0031 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:51.218143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef036-f279-409f-95f6-2804716b0031 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:51.219429 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:51.224717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f87dc6-08c0-4839-84fa-196bb7a550bf None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:51.225162 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f87dc6-08c0-4839-84fa-196bb7a550bf None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:51.225267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f87dc6-08c0-4839-84fa-196bb7a550bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:51.242474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-e4f87dc6-08c0-4839-84fa-196bb7a550bf None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:51.243666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e4f87dc6-08c0-4839-84fa-196bb7a550bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:51.252328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:51.293635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ef036-f279-409f-95f6-2804716b0031 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:51.307624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ef036-f279-409f-95f6-2804716b0031 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:51.313598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa78e4e-c1b8-43f8-9170-825d4db0c0c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:51.314233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa78e4e-c1b8-43f8-9170-825d4db0c0c2 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:51.314515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa78e4e-c1b8-43f8-9170-825d4db0c0c2 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:51.314790 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa78e4e-c1b8-43f8-9170-825d4db0c0c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:51.322542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa78e4e-c1b8-43f8-9170-825d4db0c0c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:51.324163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa78e4e-c1b8-43f8-9170-825d4db0c0c2 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:51.335119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 707/1416] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:52.319289 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe3c0c-38d4-4368-9f30-1b51432f6b58 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:52.319899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe3c0c-38d4-4368-9f30-1b51432f6b58 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:52.319899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe3c0c-38d4-4368-9f30-1b51432f6b58 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:52.321160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:52.325998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a55d0-784f-4549-bece-6bde8a76f6b8 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:52.327148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a55d0-784f-4549-bece-6bde8a76f6b8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:52.327300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a55d0-784f-4549-bece-6bde8a76f6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:52.345931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-226a55d0-784f-4549-bece-6bde8a76f6b8 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:52.347124 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-226a55d0-784f-4549-bece-6bde8a76f6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:52.354885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:52.520530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe3c0c-38d4-4368-9f30-1b51432f6b58 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:52.534694 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe3c0c-38d4-4368-9f30-1b51432f6b58 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:52.540100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce1fd9-df0d-4f24-bcb8-a89d719f572d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:52.540743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1fd9-df0d-4f24-bcb8-a89d719f572d service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:52.541027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1fd9-df0d-4f24-bcb8-a89d719f572d service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:52.541302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1fd9-df0d-4f24-bcb8-a89d719f572d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:52.550075 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce1fd9-df0d-4f24-bcb8-a89d719f572d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:52.551645 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce1fd9-df0d-4f24-bcb8-a89d719f572d service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:52.562072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 711/1419] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:53.543926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f9a6-67d4-4bc6-acc8-e69150cea8ac None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:53.544621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f9a6-67d4-4bc6-acc8-e69150cea8ac None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:53.544732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f9a6-67d4-4bc6-acc8-e69150cea8ac None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:53.546819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:41:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:53.552044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec824612-e996-4637-b983-a104321c3726 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:53.552542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec824612-e996-4637-b983-a104321c3726 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:53.552655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec824612-e996-4637-b983-a104321c3726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:53.571348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-ec824612-e996-4637-b983-a104321c3726 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:53.572589 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ec824612-e996-4637-b983-a104321c3726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:53.581224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:53.735316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773f9a6-67d4-4bc6-acc8-e69150cea8ac None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:53.749580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773f9a6-67d4-4bc6-acc8-e69150cea8ac None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:53.754825 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c3f07-fef4-436c-8a92-db1c69c954ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:53.755459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c3f07-fef4-436c-8a92-db1c69c954ac service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:53.755766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c3f07-fef4-436c-8a92-db1c69c954ac service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:53.756044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c3f07-fef4-436c-8a92-db1c69c954ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:53.764445 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c3f07-fef4-436c-8a92-db1c69c954ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:53.766050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c3f07-fef4-436c-8a92-db1c69c954ac service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:53.775643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 710/1422] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:54.699390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac582227-fb7e-406a-b0f8-c53b80cb31d8 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:54.699977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac582227-fb7e-406a-b0f8-c53b80cb31d8 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:54.700074 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac582227-fb7e-406a-b0f8-c53b80cb31d8 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:54.701965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:54.707109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa462081-fdb6-4328-b1ec-b60de2959e2d None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:54.707570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa462081-fdb6-4328-b1ec-b60de2959e2d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:54.707666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa462081-fdb6-4328-b1ec-b60de2959e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:54.726362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-aa462081-fdb6-4328-b1ec-b60de2959e2d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:54.727537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-aa462081-fdb6-4328-b1ec-b60de2959e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:54.735536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:54.886705 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac582227-fb7e-406a-b0f8-c53b80cb31d8 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:54.901449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac582227-fb7e-406a-b0f8-c53b80cb31d8 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:54.907496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ec69b-19db-44b9-bb2b-66b71a94ae72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:54.908173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec69b-19db-44b9-bb2b-66b71a94ae72 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:54.908459 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec69b-19db-44b9-bb2b-66b71a94ae72 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:54.908734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec69b-19db-44b9-bb2b-66b71a94ae72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:54.917295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ec69b-19db-44b9-bb2b-66b71a94ae72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:54.919070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ec69b-19db-44b9-bb2b-66b71a94ae72 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:54.928783 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 714/1425] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:55.870640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5b83b-70e0-45c8-9574-1fe2bc00ab31 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:55.871231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5b83b-70e0-45c8-9574-1fe2bc00ab31 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:55.871336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5b83b-70e0-45c8-9574-1fe2bc00ab31 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:55.872744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:55.878093 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3983b9-7ac1-498f-bdf7-a4c2544d0270 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:55.878541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3983b9-7ac1-498f-bdf7-a4c2544d0270 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:55.878642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3983b9-7ac1-498f-bdf7-a4c2544d0270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:55.896773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-4b3983b9-7ac1-498f-bdf7-a4c2544d0270 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:55.897973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4b3983b9-7ac1-498f-bdf7-a4c2544d0270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:55.906511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:56.058794 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5b83b-70e0-45c8-9574-1fe2bc00ab31 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:56.073071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5b83b-70e0-45c8-9574-1fe2bc00ab31 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:56.078474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17429e5-5785-4ad9-ab9b-24d37f86b7a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:56.079132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17429e5-5785-4ad9-ab9b-24d37f86b7a9 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:56.079415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17429e5-5785-4ad9-ab9b-24d37f86b7a9 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:56.079691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17429e5-5785-4ad9-ab9b-24d37f86b7a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:56.087523 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17429e5-5785-4ad9-ab9b-24d37f86b7a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:56.089133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17429e5-5785-4ad9-ab9b-24d37f86b7a9 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:56.098976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 713/1428] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:56.976425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f42b6-b517-4378-893a-37cb5cb608c4 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:56.976937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f42b6-b517-4378-893a-37cb5cb608c4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:56.977052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f42b6-b517-4378-893a-37cb5cb608c4 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:56.978349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:56.983481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394c513-65e7-4401-836c-da3831146a6e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:56.983952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394c513-65e7-4401-836c-da3831146a6e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:56.984076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394c513-65e7-4401-836c-da3831146a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:57.001543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-5394c513-65e7-4401-836c-da3831146a6e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:57.002717 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5394c513-65e7-4401-836c-da3831146a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:57.010432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:57.160685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f42b6-b517-4378-893a-37cb5cb608c4 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:57.175735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f42b6-b517-4378-893a-37cb5cb608c4 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:57.181124 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75e8a3-8a6d-435d-8a0f-0b87f8abd9d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:57.181771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75e8a3-8a6d-435d-8a0f-0b87f8abd9d5 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:57.182052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75e8a3-8a6d-435d-8a0f-0b87f8abd9d5 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:57.182409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75e8a3-8a6d-435d-8a0f-0b87f8abd9d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:57.190998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75e8a3-8a6d-435d-8a0f-0b87f8abd9d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:57.192550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75e8a3-8a6d-435d-8a0f-0b87f8abd9d5 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:57.201859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 717/1431] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:58.086466 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256c7cb-d279-4663-ae7c-4d55d4366b2a None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:58.087009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256c7cb-d279-4663-ae7c-4d55d4366b2a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:58.087009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256c7cb-d279-4663-ae7c-4d55d4366b2a None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:58.088420 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:58.094203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c0bd3-d775-4cfe-b6b0-560cd3e27d5d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:58.094628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c0bd3-d775-4cfe-b6b0-560cd3e27d5d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:58.094764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c0bd3-d775-4cfe-b6b0-560cd3e27d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:58.112935 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-ef8c0bd3-d775-4cfe-b6b0-560cd3e27d5d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:58.114137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ef8c0bd3-d775-4cfe-b6b0-560cd3e27d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:58.121889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:58.270670 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256c7cb-d279-4663-ae7c-4d55d4366b2a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:58.284921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256c7cb-d279-4663-ae7c-4d55d4366b2a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:58.290225 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e22ed-c838-4e20-bf96-1a52960bbe00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:58.290857 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e22ed-c838-4e20-bf96-1a52960bbe00 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:58.291137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e22ed-c838-4e20-bf96-1a52960bbe00 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:58.291412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e22ed-c838-4e20-bf96-1a52960bbe00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:58.299438 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e22ed-c838-4e20-bf96-1a52960bbe00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:58.301047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e22ed-c838-4e20-bf96-1a52960bbe00 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:58.310037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 716/1434] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:41:59.187088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3aacd-caf8-4f21-a8b4-5f2385ecd0ad None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:59.187632 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3aacd-caf8-4f21-a8b4-5f2385ecd0ad None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:59.187632 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3aacd-caf8-4f21-a8b4-5f2385ecd0ad None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:59.188928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:41:59.193817 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2bfd0-adc2-4ab3-bcc5-bacf86e13145 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:59.194226 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2bfd0-adc2-4ab3-bcc5-bacf86e13145 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:59.194370 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2bfd0-adc2-4ab3-bcc5-bacf86e13145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:59.212324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-5af2bfd0-adc2-4ab3-bcc5-bacf86e13145 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:41:59.213567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5af2bfd0-adc2-4ab3-bcc5-bacf86e13145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:41:59.222347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:41:59.372070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3aacd-caf8-4f21-a8b4-5f2385ecd0ad None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:41:59.386287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3aacd-caf8-4f21-a8b4-5f2385ecd0ad None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:41:59.392398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d61761-67d3-4f8b-b0c3-0e4969dfb0a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:41:59.393027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d61761-67d3-4f8b-b0c3-0e4969dfb0a3 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:41:59.393305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d61761-67d3-4f8b-b0c3-0e4969dfb0a3 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:41:59.393575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d61761-67d3-4f8b-b0c3-0e4969dfb0a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:41:59.401381 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d61761-67d3-4f8b-b0c3-0e4969dfb0a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:41:59.402935 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d61761-67d3-4f8b-b0c3-0e4969dfb0a3 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:41:59.412787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 720/1437] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:00.302719 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974b372-9f7b-44b0-9bee-c944f732748c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:00.303258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974b372-9f7b-44b0-9bee-c944f732748c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:00.303258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974b372-9f7b-44b0-9bee-c944f732748c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:00.304613 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:42:00.309586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c217f32-a6c2-4b64-9b22-f5d3ce85c20e None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:00.310004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c217f32-a6c2-4b64-9b22-f5d3ce85c20e None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:00.310134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c217f32-a6c2-4b64-9b22-f5d3ce85c20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:00.328766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-1c217f32-a6c2-4b64-9b22-f5d3ce85c20e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:00.329983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1c217f32-a6c2-4b64-9b22-f5d3ce85c20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:00.338567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:00.487241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974b372-9f7b-44b0-9bee-c944f732748c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:00.502110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974b372-9f7b-44b0-9bee-c944f732748c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:00.507389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de2f7e-b5bc-4bc5-9fad-332c10d975c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:00.508063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de2f7e-b5bc-4bc5-9fad-332c10d975c9 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:00.508350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de2f7e-b5bc-4bc5-9fad-332c10d975c9 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:00.508632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de2f7e-b5bc-4bc5-9fad-332c10d975c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:00.517546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de2f7e-b5bc-4bc5-9fad-332c10d975c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:00.519139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de2f7e-b5bc-4bc5-9fad-332c10d975c9 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:00.528293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 719/1440] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:02.604697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e618fa1-e9e8-4c67-9a3c-3be84e8e897f None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:02.605297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e618fa1-e9e8-4c67-9a3c-3be84e8e897f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:02.605297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e618fa1-e9e8-4c67-9a3c-3be84e8e897f None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:02.606594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:42:02.612384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe28d-57c6-4f94-81c8-1ba55ffbf894 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:02.612787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe28d-57c6-4f94-81c8-1ba55ffbf894 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:02.612940 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe28d-57c6-4f94-81c8-1ba55ffbf894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:02.631165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-229fe28d-57c6-4f94-81c8-1ba55ffbf894 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:02.632365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-229fe28d-57c6-4f94-81c8-1ba55ffbf894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:02.639953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:02.677198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e618fa1-e9e8-4c67-9a3c-3be84e8e897f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:02.678890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5e618fa1-e9e8-4c67-9a3c-3be84e8e897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:02.692162 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e618fa1-e9e8-4c67-9a3c-3be84e8e897f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:02.695608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02340145-3562-4297-82ed-aff0a546a679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:02.696273 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02340145-3562-4297-82ed-aff0a546a679 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:02.696555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02340145-3562-4297-82ed-aff0a546a679 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:02.696823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02340145-3562-4297-82ed-aff0a546a679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:02.705512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02340145-3562-4297-82ed-aff0a546a679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:02.706918 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02340145-3562-4297-82ed-aff0a546a679 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:02.716140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 723/1443] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:05.134436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf98ae-0df3-4520-b0d0-605532b36e19 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:05.135003 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf98ae-0df3-4520-b0d0-605532b36e19 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:05.135003 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf98ae-0df3-4520-b0d0-605532b36e19 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:05.136421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:42:05.142808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce7ea-7617-44fc-9f9d-c5f32ab0d930 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:05.143244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce7ea-7617-44fc-9f9d-c5f32ab0d930 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:05.143380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce7ea-7617-44fc-9f9d-c5f32ab0d930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:05.161882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-cc1ce7ea-7617-44fc-9f9d-c5f32ab0d930 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:05.163047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-cc1ce7ea-7617-44fc-9f9d-c5f32ab0d930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:05.171124 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:05.208732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf98ae-0df3-4520-b0d0-605532b36e19 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:05.220066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf98ae-0df3-4520-b0d0-605532b36e19 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:05.223500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5890c14-75c0-4646-b7cd-3c4dc15cd160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:05.224201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5890c14-75c0-4646-b7cd-3c4dc15cd160 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:05.224482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5890c14-75c0-4646-b7cd-3c4dc15cd160 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:05.224765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5890c14-75c0-4646-b7cd-3c4dc15cd160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:05.234154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5890c14-75c0-4646-b7cd-3c4dc15cd160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:05.235584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5890c14-75c0-4646-b7cd-3c4dc15cd160 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:05.244793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 722/1446] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:07.877022 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b849011-53f0-40c6-91e9-6b9b86e45b79 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:07.877629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b849011-53f0-40c6-91e9-6b9b86e45b79 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:07.877629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b849011-53f0-40c6-91e9-6b9b86e45b79 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:07.878990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:42:07.884920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bf398-3f3d-4dc0-82e0-7b26579ba1a3 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:07.885361 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bf398-3f3d-4dc0-82e0-7b26579ba1a3 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:07.885484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bf398-3f3d-4dc0-82e0-7b26579ba1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:07.903309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-ee8bf398-3f3d-4dc0-82e0-7b26579ba1a3 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:07.905584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ee8bf398-3f3d-4dc0-82e0-7b26579ba1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:07.913378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:07.955612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b849011-53f0-40c6-91e9-6b9b86e45b79 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:07.973319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b849011-53f0-40c6-91e9-6b9b86e45b79 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:07.976861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b096c-75fc-4f32-87d0-8ca07f4e050f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:07.977503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b096c-75fc-4f32-87d0-8ca07f4e050f service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:07.977783 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b096c-75fc-4f32-87d0-8ca07f4e050f service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:07.978057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b096c-75fc-4f32-87d0-8ca07f4e050f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:07.987466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b096c-75fc-4f32-87d0-8ca07f4e050f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:07.988923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b096c-75fc-4f32-87d0-8ca07f4e050f service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:07.998466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 726/1449] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:10.310833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca9adf-1c99-416c-8a12-c54859a27807 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:10.311385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca9adf-1c99-416c-8a12-c54859a27807 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:10.311385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca9adf-1c99-416c-8a12-c54859a27807 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:10.312692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:42:10.318308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70b7f-7cf2-4e0d-9776-03a45da74170 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:10.318723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70b7f-7cf2-4e0d-9776-03a45da74170 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:10.318868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70b7f-7cf2-4e0d-9776-03a45da74170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:10.337090 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-41a70b7f-7cf2-4e0d-9776-03a45da74170 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:10.338282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-41a70b7f-7cf2-4e0d-9776-03a45da74170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:10.346843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:10.384966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca9adf-1c99-416c-8a12-c54859a27807 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:10.396695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca9adf-1c99-416c-8a12-c54859a27807 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:10.400162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc0532-b94e-4236-8e26-77c2cbf1998f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:10.400797 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc0532-b94e-4236-8e26-77c2cbf1998f service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:10.401080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc0532-b94e-4236-8e26-77c2cbf1998f service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:10.401358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc0532-b94e-4236-8e26-77c2cbf1998f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:10.410663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc0532-b94e-4236-8e26-77c2cbf1998f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:10.412119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc0532-b94e-4236-8e26-77c2cbf1998f service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:10.421215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 725/1452] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:12.766907 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9bf5e-ca9f-4622-8ff4-80ac2cf407bb None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:12.767537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9bf5e-ca9f-4622-8ff4-80ac2cf407bb None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:12.767537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9bf5e-ca9f-4622-8ff4-80ac2cf407bb None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:12.768841 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:42:12.774041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96245279-8ff2-4b2e-acf5-15bc6ab49571 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:12.774476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96245279-8ff2-4b2e-acf5-15bc6ab49571 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:12.774596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96245279-8ff2-4b2e-acf5-15bc6ab49571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:12.791642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-96245279-8ff2-4b2e-acf5-15bc6ab49571 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:12.792853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-96245279-8ff2-4b2e-acf5-15bc6ab49571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:12.801209 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:12.839287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9bf5e-ca9f-4622-8ff4-80ac2cf407bb None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:12.849994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9bf5e-ca9f-4622-8ff4-80ac2cf407bb None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:12.853434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aea1f9-198d-496e-933e-24cd7f32e14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:12.854064 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aea1f9-198d-496e-933e-24cd7f32e14f service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:12.854343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aea1f9-198d-496e-933e-24cd7f32e14f service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:12.854615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aea1f9-198d-496e-933e-24cd7f32e14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:12.863683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aea1f9-198d-496e-933e-24cd7f32e14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:12.865113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aea1f9-198d-496e-933e-24cd7f32e14f service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:12.874688 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 729/1455] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:15.204559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b17ff-3fee-442d-85fb-5d89f9473fe5 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:15.205099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b17ff-3fee-442d-85fb-5d89f9473fe5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:15.205099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b17ff-3fee-442d-85fb-5d89f9473fe5 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:15.206412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:42:15.212314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3933be-b346-4660-b624-d4256225674b None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:15.212857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3933be-b346-4660-b624-d4256225674b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:15.212857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3933be-b346-4660-b624-d4256225674b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:15.231351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2f3933be-b346-4660-b624-d4256225674b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:15.232753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2f3933be-b346-4660-b624-d4256225674b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:15.240516 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:15.284795 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b17ff-3fee-442d-85fb-5d89f9473fe5 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:15.295860 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b17ff-3fee-442d-85fb-5d89f9473fe5 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:15.299310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4ae42-8235-4fad-8bd2-4a63e4498a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:15.299987 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ae42-8235-4fad-8bd2-4a63e4498a88 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:15.300274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ae42-8235-4fad-8bd2-4a63e4498a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:15.300555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ae42-8235-4fad-8bd2-4a63e4498a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:15.309434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4ae42-8235-4fad-8bd2-4a63e4498a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:15.311387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4ae42-8235-4fad-8bd2-4a63e4498a88 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:15.320491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 728/1458] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:17.639940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27493160-d390-401a-8f6a-57a93ff9c705 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:17.640530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27493160-d390-401a-8f6a-57a93ff9c705 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:17.640530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27493160-d390-401a-8f6a-57a93ff9c705 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:17.641860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:42:17.647286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2dd1a-174c-4a64-b7e6-8a7226ca9a40 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:17.647678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2dd1a-174c-4a64-b7e6-8a7226ca9a40 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:17.647890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2dd1a-174c-4a64-b7e6-8a7226ca9a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:17.665207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d7e2dd1a-174c-4a64-b7e6-8a7226ca9a40 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:17.666385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d7e2dd1a-174c-4a64-b7e6-8a7226ca9a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:17.675324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:17.712795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27493160-d390-401a-8f6a-57a93ff9c705 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:17.725208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27493160-d390-401a-8f6a-57a93ff9c705 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:17.728621 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115ebb3-e907-4ea6-a751-cc978901881b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:17.729257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115ebb3-e907-4ea6-a751-cc978901881b service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:17.729534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115ebb3-e907-4ea6-a751-cc978901881b service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:17.729805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115ebb3-e907-4ea6-a751-cc978901881b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:17.739008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115ebb3-e907-4ea6-a751-cc978901881b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:17.740441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115ebb3-e907-4ea6-a751-cc978901881b service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:17.749664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 732/1461] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:20.029167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e102a0-b8d6-4e18-a289-b934d31ebcd0 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:20.029734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e102a0-b8d6-4e18-a289-b934d31ebcd0 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:20.029734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e102a0-b8d6-4e18-a289-b934d31ebcd0 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:20.031095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:42:20.036413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c818-f604-4952-97c2-15726eb35015 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:20.036851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c818-f604-4952-97c2-15726eb35015 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:20.036962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c818-f604-4952-97c2-15726eb35015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:20.054155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8d76c818-f604-4952-97c2-15726eb35015 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:20.055335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8d76c818-f604-4952-97c2-15726eb35015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:20.063937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:20.100872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e102a0-b8d6-4e18-a289-b934d31ebcd0 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:20.111695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e102a0-b8d6-4e18-a289-b934d31ebcd0 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:20.115215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e163b83-75ef-4f3a-8ffa-5a83b55a0059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:20.115889 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e163b83-75ef-4f3a-8ffa-5a83b55a0059 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:20.116175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e163b83-75ef-4f3a-8ffa-5a83b55a0059 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:20.116451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e163b83-75ef-4f3a-8ffa-5a83b55a0059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:20.125933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e163b83-75ef-4f3a-8ffa-5a83b55a0059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:20.127397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e163b83-75ef-4f3a-8ffa-5a83b55a0059 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:20.136554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 731/1464] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:22.363770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a80f21-e53d-46ce-8c52-a1a35f014f6d None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:22.364318 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a80f21-e53d-46ce-8c52-a1a35f014f6d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:22.364318 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a80f21-e53d-46ce-8c52-a1a35f014f6d None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:22.365687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:42:22.371108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b87ce7-7cdd-48a9-b944-bab7b7fc9e2c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:22.371514 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b87ce7-7cdd-48a9-b944-bab7b7fc9e2c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:22.371652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b87ce7-7cdd-48a9-b944-bab7b7fc9e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:22.389755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-08b87ce7-7cdd-48a9-b944-bab7b7fc9e2c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:22.390855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-08b87ce7-7cdd-48a9-b944-bab7b7fc9e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:22.398442 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:22.433657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a80f21-e53d-46ce-8c52-a1a35f014f6d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:22.444911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a80f21-e53d-46ce-8c52-a1a35f014f6d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:22.448373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec98fdb-d35d-4b8c-935c-74402c270a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:22.449010 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec98fdb-d35d-4b8c-935c-74402c270a3c service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:22.449319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec98fdb-d35d-4b8c-935c-74402c270a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:22.449588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec98fdb-d35d-4b8c-935c-74402c270a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:22.458572 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec98fdb-d35d-4b8c-935c-74402c270a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:22.460012 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec98fdb-d35d-4b8c-935c-74402c270a3c service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:22.469522 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 735/1467] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:24.720720 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8af481-2e78-4cef-aa07-fe848c40cc0c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:24.721301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8af481-2e78-4cef-aa07-fe848c40cc0c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:24.721301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8af481-2e78-4cef-aa07-fe848c40cc0c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:24.722639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:42:24.728157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c6122-8453-4cb2-8cce-21c5040d1b90 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:24.728600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c6122-8453-4cb2-8cce-21c5040d1b90 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:24.728721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c6122-8453-4cb2-8cce-21c5040d1b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:24.746296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-780c6122-8453-4cb2-8cce-21c5040d1b90 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:24.748181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-780c6122-8453-4cb2-8cce-21c5040d1b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:24.755933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:24.792691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8af481-2e78-4cef-aa07-fe848c40cc0c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:24.804020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8af481-2e78-4cef-aa07-fe848c40cc0c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:24.807495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5db8d4-f651-446a-b33f-671030b478a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:24.808183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5db8d4-f651-446a-b33f-671030b478a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:24.808469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5db8d4-f651-446a-b33f-671030b478a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:24.808751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5db8d4-f651-446a-b33f-671030b478a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:24.818003 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5db8d4-f651-446a-b33f-671030b478a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:24.819454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5db8d4-f651-446a-b33f-671030b478a0 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:24.828619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 734/1470] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:42:58.332875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7b6b-4d68-4e10-b219-6eebd259ce39 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:58.333535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7b6b-4d68-4e10-b219-6eebd259ce39 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:58.333535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d7b6b-4d68-4e10-b219-6eebd259ce39 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:58.334736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 737/1471] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:42:58.339920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5728-d312-4cbb-ac5a-d60d4fcd0afd None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:58.340427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5728-d312-4cbb-ac5a-d60d4fcd0afd None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:58.340651 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5728-d312-4cbb-ac5a-d60d4fcd0afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:58.358384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f6cf5728-d312-4cbb-ac5a-d60d4fcd0afd None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:58.359563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f6cf5728-d312-4cbb-ac5a-d60d4fcd0afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:58.367225 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 735/1472] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:58.413956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faa397-db67-44ac-a8e4-cf0468c97f78 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:58.414232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faa397-db67-44ac-a8e4-cf0468c97f78 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:58.414507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faa397-db67-44ac-a8e4-cf0468c97f78 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:58.415898 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 738/1473] 10.222.0.72 () {54 vars in 962 bytes} [Mon May 16 18:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:42:58.421349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e979-96fe-4ff7-93a3-16f80f919544 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:58.421635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e979-96fe-4ff7-93a3-16f80f919544 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:58.421914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e979-96fe-4ff7-93a3-16f80f919544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:58.439672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-3191e979-96fe-4ff7-93a3-16f80f919544 None None] MFA Rules not processed for user `6f0e623c10804239a076fc6cde9b198d`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:42:58.440868 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3191e979-96fe-4ff7-93a3-16f80f919544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:42:58.447168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 736/1474] 10.222.0.72 () {58 vars in 1059 bytes} [Mon May 16 18:42:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:42:58.454468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faa397-db67-44ac-a8e4-cf0468c97f78 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:42:58.464985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faa397-db67-44ac-a8e4-cf0468c97f78 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:42:58.468751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f215592-4273-4b77-983b-f198343a1e06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0e623c10804239a076fc6cde9b198d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:42:58.469435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215592-4273-4b77-983b-f198343a1e06 service glance] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:42:58.469663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215592-4273-4b77-983b-f198343a1e06 service glance] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:42:58.469937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215592-4273-4b77-983b-f198343a1e06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:42:58.478806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f215592-4273-4b77-983b-f198343a1e06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:42:58.480264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f215592-4273-4b77-983b-f198343a1e06 service glance] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:42:58.489979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 739/1475] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:43:00.802920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14404-4dd1-4787-ba50-487e7d8cc233 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:00.803485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14404-4dd1-4787-ba50-487e7d8cc233 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:00.803485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14404-4dd1-4787-ba50-487e7d8cc233 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:00.804930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 737/1476] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:43:00.810782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2779-1bd4-42ec-b614-484696e89024 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:00.811276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2779-1bd4-42ec-b614-484696e89024 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:00.811414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2779-1bd4-42ec-b614-484696e89024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:00.829342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-04be2779-1bd4-42ec-b614-484696e89024 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:43:00.830519 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-04be2779-1bd4-42ec-b614-484696e89024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:43:00.838228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 740/1477] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:43:00.861404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14404-4dd1-4787-ba50-487e7d8cc233 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:43:00.874345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14404-4dd1-4787-ba50-487e7d8cc233 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:43:00.878794 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176b077-8ce3-40eb-a0a2-bdb7545f6a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:43:00.879439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176b077-8ce3-40eb-a0a2-bdb7545f6a5b admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:00.879737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176b077-8ce3-40eb-a0a2-bdb7545f6a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:00.880025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176b077-8ce3-40eb-a0a2-bdb7545f6a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:00.880799 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176b077-8ce3-40eb-a0a2-bdb7545f6a5b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:43:00.882495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: WARNING py.warnings [None req-1176b077-8ce3-40eb-a0a2-bdb7545f6a5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 18:43:00.882495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: warnings.warn(msg) May 16 18:43:00.882495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: May 16 18:43:00.883622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176b077-8ce3-40eb-a0a2-bdb7545f6a5b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:43:00.902289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 738/1478] 10.222.0.72 () {56 vars in 1108 bytes} [Mon May 16 18:43:00 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:43:03.159950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58160c-2bf2-44e4-a2e7-f0f2e5ac9a6d None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:03.160517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58160c-2bf2-44e4-a2e7-f0f2e5ac9a6d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:03.160517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58160c-2bf2-44e4-a2e7-f0f2e5ac9a6d None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:03.161876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 741/1479] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:43:03.167200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e3e8-b473-469f-a77a-cd6cf5e3a4c7 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:03.167637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e3e8-b473-469f-a77a-cd6cf5e3a4c7 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:03.167801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e3e8-b473-469f-a77a-cd6cf5e3a4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:03.185834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-6875e3e8-b473-469f-a77a-cd6cf5e3a4c7 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:43:03.187007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-6875e3e8-b473-469f-a77a-cd6cf5e3a4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:43:03.194655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 739/1480] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:43:03.236511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58160c-2bf2-44e4-a2e7-f0f2e5ac9a6d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:43:03.251002 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58160c-2bf2-44e4-a2e7-f0f2e5ac9a6d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:43:03.256352 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ccf20-f36c-4b21-b6d0-5cd3e47db2c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:43:03.256986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ccf20-f36c-4b21-b6d0-5cd3e47db2c5 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:03.257296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ccf20-f36c-4b21-b6d0-5cd3e47db2c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:03.257573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ccf20-f36c-4b21-b6d0-5cd3e47db2c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:03.266076 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ccf20-f36c-4b21-b6d0-5cd3e47db2c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:43:03.267633 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ccf20-f36c-4b21-b6d0-5cd3e47db2c5 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:43:03.276754 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 742/1481] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:43:05.669369 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ed27-1b8d-4c70-b1b6-2666f0841251 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:05.669916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ed27-1b8d-4c70-b1b6-2666f0841251 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:05.669916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ed27-1b8d-4c70-b1b6-2666f0841251 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:05.671275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 740/1482] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:43:05.676471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adc04f-29ba-42cd-b663-56c086ff26fa None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:05.676887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adc04f-29ba-42cd-b663-56c086ff26fa None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:05.677019 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adc04f-29ba-42cd-b663-56c086ff26fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:05.695100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-35adc04f-29ba-42cd-b663-56c086ff26fa None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:43:05.696310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-35adc04f-29ba-42cd-b663-56c086ff26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:43:05.704253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 743/1483] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:43:05.740215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3ed27-1b8d-4c70-b1b6-2666f0841251 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:43:05.751644 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3ed27-1b8d-4c70-b1b6-2666f0841251 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:43:05.759277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963752e-6b0a-4daf-a2c8-69e2e76a6aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:43:05.759277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963752e-6b0a-4daf-a2c8-69e2e76a6aec service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:05.759277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963752e-6b0a-4daf-a2c8-69e2e76a6aec service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:05.759277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963752e-6b0a-4daf-a2c8-69e2e76a6aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:05.765591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963752e-6b0a-4daf-a2c8-69e2e76a6aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:43:05.767006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963752e-6b0a-4daf-a2c8-69e2e76a6aec service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:43:05.776165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 741/1484] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:43:08.038624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c9e03-5ccf-41e8-8eaa-589288e0bc14 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:08.039213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c9e03-5ccf-41e8-8eaa-589288e0bc14 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:08.039213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c9e03-5ccf-41e8-8eaa-589288e0bc14 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:08.040567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 744/1485] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:43:08.045894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53c1a-3d48-432e-ab9c-480391861ce5 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:08.046314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53c1a-3d48-432e-ab9c-480391861ce5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:08.046466 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53c1a-3d48-432e-ab9c-480391861ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:08.063344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-e6a53c1a-3d48-432e-ab9c-480391861ce5 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:43:08.064563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e6a53c1a-3d48-432e-ab9c-480391861ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:43:08.072150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 742/1486] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:43:08.109743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c9e03-5ccf-41e8-8eaa-589288e0bc14 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:43:08.120231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c9e03-5ccf-41e8-8eaa-589288e0bc14 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:43:08.123699 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb584e9-275d-45af-b7b3-2ca25a2e3af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:43:08.124366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb584e9-275d-45af-b7b3-2ca25a2e3af1 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:08.124650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb584e9-275d-45af-b7b3-2ca25a2e3af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:08.124928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb584e9-275d-45af-b7b3-2ca25a2e3af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:08.133598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb584e9-275d-45af-b7b3-2ca25a2e3af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:43:08.135054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb584e9-275d-45af-b7b3-2ca25a2e3af1 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:43:08.144766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 745/1487] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:43:10.522653 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a598-57bb-468f-ac34-1aab35c75faf None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:10.523282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a598-57bb-468f-ac34-1aab35c75faf None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:10.523282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a598-57bb-468f-ac34-1aab35c75faf None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:10.524594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 743/1488] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:43:10.529927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c602e-526d-43cf-aa4c-dafa159743f8 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:10.530350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c602e-526d-43cf-aa4c-dafa159743f8 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:10.530485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c602e-526d-43cf-aa4c-dafa159743f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:10.547580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-f94c602e-526d-43cf-aa4c-dafa159743f8 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:43:10.548772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-f94c602e-526d-43cf-aa4c-dafa159743f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:43:10.556368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 746/1489] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:43:10.596501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764a598-57bb-468f-ac34-1aab35c75faf None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:43:10.606991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764a598-57bb-468f-ac34-1aab35c75faf None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:43:10.610527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee97f49-d6b8-4a85-b4cd-e7800101ebea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:43:10.611167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee97f49-d6b8-4a85-b4cd-e7800101ebea service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:10.611449 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee97f49-d6b8-4a85-b4cd-e7800101ebea service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:10.611745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee97f49-d6b8-4a85-b4cd-e7800101ebea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:10.620432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee97f49-d6b8-4a85-b4cd-e7800101ebea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:43:10.622580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee97f49-d6b8-4a85-b4cd-e7800101ebea service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:43:10.631690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 744/1490] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:43:13.072766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fccdc-e22d-4d22-bc25-f01ee1732599 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:13.073354 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fccdc-e22d-4d22-bc25-f01ee1732599 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:13.073354 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fccdc-e22d-4d22-bc25-f01ee1732599 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:13.075014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 747/1491] 10.222.0.72 () {54 vars in 926 bytes} [Mon May 16 18:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:43:13.080415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a30012-54ea-4f3b-bc68-b2561a4abd07 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:13.080872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a30012-54ea-4f3b-bc68-b2561a4abd07 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:13.080973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a30012-54ea-4f3b-bc68-b2561a4abd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:13.098806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f0a30012-54ea-4f3b-bc68-b2561a4abd07 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:43:13.100015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f0a30012-54ea-4f3b-bc68-b2561a4abd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:43:13.119122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 745/1492] 10.222.0.72 () {58 vars in 1023 bytes} [Mon May 16 18:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:43:13.159190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fccdc-e22d-4d22-bc25-f01ee1732599 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:43:13.170464 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fccdc-e22d-4d22-bc25-f01ee1732599 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:43:13.173996 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427ad46-8c30-47b8-9e66-af6960ef636e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:43:13.174668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427ad46-8c30-47b8-9e66-af6960ef636e service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:43:13.174948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427ad46-8c30-47b8-9e66-af6960ef636e service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:43:13.175223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427ad46-8c30-47b8-9e66-af6960ef636e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:43:13.184463 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427ad46-8c30-47b8-9e66-af6960ef636e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:43:13.185518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427ad46-8c30-47b8-9e66-af6960ef636e service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:43:13.194596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 748/1493] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:44:47.743310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441287b9-e9c0-46ca-b669-ae20f13354df None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:47.744019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441287b9-e9c0-46ca-b669-ae20f13354df None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:47.744019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441287b9-e9c0-46ca-b669-ae20f13354df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:47.761926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-441287b9-e9c0-46ca-b669-ae20f13354df None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:44:47.763139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-441287b9-e9c0-46ca-b669-ae20f13354df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:44:47.770796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 746/1494] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:44:47.780661 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94ac4b-8aaf-44aa-96e7-ddbc76a22620 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:47.781155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94ac4b-8aaf-44aa-96e7-ddbc76a22620 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:47.781259 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94ac4b-8aaf-44aa-96e7-ddbc76a22620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:47.798640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-fb94ac4b-8aaf-44aa-96e7-ddbc76a22620 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:44:47.799866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-fb94ac4b-8aaf-44aa-96e7-ddbc76a22620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:44:47.807770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 749/1495] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:44:47.812189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441287b9-e9c0-46ca-b669-ae20f13354df None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:44:47.822247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441287b9-e9c0-46ca-b669-ae20f13354df None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:44:47.826708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787d39f-2f11-4b9f-817f-a9b1a4d4a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:44:47.827364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d39f-2f11-4b9f-817f-a9b1a4d4a106 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:47.827648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d39f-2f11-4b9f-817f-a9b1a4d4a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:47.827956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d39f-2f11-4b9f-817f-a9b1a4d4a106 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:47.828682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787d39f-2f11-4b9f-817f-a9b1a4d4a106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:44:47.828989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787d39f-2f11-4b9f-817f-a9b1a4d4a106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:44:47.829990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: WARNING py.warnings [None req-0787d39f-2f11-4b9f-817f-a9b1a4d4a106 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:44:47.829990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: warnings.warn(msg) May 16 18:44:47.829990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: May 16 18:44:47.830864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787d39f-2f11-4b9f-817f-a9b1a4d4a106 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:44:47.842841 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 747/1496] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:44:47.850696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94ac4b-8aaf-44aa-96e7-ddbc76a22620 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:44:47.859675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94ac4b-8aaf-44aa-96e7-ddbc76a22620 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:44:47.864295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c55a4-67bb-4e19-b68c-18a32ee2c593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:44:47.864944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c55a4-67bb-4e19-b68c-18a32ee2c593 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:47.865227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c55a4-67bb-4e19-b68c-18a32ee2c593 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:47.865503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c55a4-67bb-4e19-b68c-18a32ee2c593 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:47.866202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c55a4-67bb-4e19-b68c-18a32ee2c593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:44:47.867975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: WARNING py.warnings [None req-586c55a4-67bb-4e19-b68c-18a32ee2c593 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 18:44:47.867975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: warnings.warn(msg) May 16 18:44:47.867975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: May 16 18:44:47.869176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c55a4-67bb-4e19-b68c-18a32ee2c593 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:44:47.906101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 750/1497] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:44:47 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:44:47.910574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787d39f-2f11-4b9f-817f-a9b1a4d4a106 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:44:47.920509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787d39f-2f11-4b9f-817f-a9b1a4d4a106 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:44:47.975014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95c12e-0476-4377-9f9c-765389fb4f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:44:47.975682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95c12e-0476-4377-9f9c-765389fb4f4c admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:47.975999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95c12e-0476-4377-9f9c-765389fb4f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:47.976276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95c12e-0476-4377-9f9c-765389fb4f4c admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:47.976955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95c12e-0476-4377-9f9c-765389fb4f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:44:47.978175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: WARNING py.warnings [None req-8f95c12e-0476-4377-9f9c-765389fb4f4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 18:44:47.978175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: warnings.warn(msg) May 16 18:44:47.978175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: May 16 18:44:47.979367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95c12e-0476-4377-9f9c-765389fb4f4c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:44:47.998799 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 748/1498] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:44:47 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:44:48.002888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c55a4-67bb-4e19-b68c-18a32ee2c593 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:44:48.013701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c55a4-67bb-4e19-b68c-18a32ee2c593 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:44:48.018181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182040af-545a-47af-8fbf-c75a3e2fbc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:44:48.018951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182040af-545a-47af-8fbf-c75a3e2fbc70 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:48.019235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182040af-545a-47af-8fbf-c75a3e2fbc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:48.019506 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182040af-545a-47af-8fbf-c75a3e2fbc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:48.020266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182040af-545a-47af-8fbf-c75a3e2fbc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:44:48.021266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: WARNING py.warnings [None req-182040af-545a-47af-8fbf-c75a3e2fbc70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:44:48.021266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: warnings.warn(msg) May 16 18:44:48.021266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: May 16 18:44:48.022135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182040af-545a-47af-8fbf-c75a3e2fbc70 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:44:48.034887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 751/1499] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:44:48.038810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95c12e-0476-4377-9f9c-765389fb4f4c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:44:48.048317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95c12e-0476-4377-9f9c-765389fb4f4c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:44:48.052745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31485447-7d5c-40f4-a38d-ee7249c4cb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:44:48.053399 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485447-7d5c-40f4-a38d-ee7249c4cb61 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:48.053680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485447-7d5c-40f4-a38d-ee7249c4cb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:48.053958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485447-7d5c-40f4-a38d-ee7249c4cb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:48.054681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31485447-7d5c-40f4-a38d-ee7249c4cb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:44:48.056198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: WARNING py.warnings [None req-31485447-7d5c-40f4-a38d-ee7249c4cb61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:44:48.056198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: warnings.warn(msg) May 16 18:44:48.056198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: May 16 18:44:48.057065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31485447-7d5c-40f4-a38d-ee7249c4cb61 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:44:48.069982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 749/1500] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:44:48.074662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182040af-545a-47af-8fbf-c75a3e2fbc70 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:44:48.084280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182040af-545a-47af-8fbf-c75a3e2fbc70 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:44:48.088755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a98465-5464-4b7e-8847-0a015e9d22de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:44:48.089630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a98465-5464-4b7e-8847-0a015e9d22de admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:48.089914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a98465-5464-4b7e-8847-0a015e9d22de admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:48.090190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a98465-5464-4b7e-8847-0a015e9d22de admin admin] PATH_INFO: `/v3/projects/1a943f75527844979f37d5641cdfc369/users/a61b87d53f03420ebe0672deae58d979/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:48.105489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a98465-5464-4b7e-8847-0a015e9d22de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a943f75527844979f37d5641cdfc369, user_id=a61b87d53f03420ebe0672deae58d979, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:44:48.106520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: WARNING py.warnings [None req-16a98465-5464-4b7e-8847-0a015e9d22de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 18:44:48.106520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: warnings.warn(msg) May 16 18:44:48.106520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: May 16 18:44:48.108557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a98465-5464-4b7e-8847-0a015e9d22de admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:44:48.122062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 752/1501] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:44:48 2022] PUT /identity/v3/projects/1a943f75527844979f37d5641cdfc369/users/a61b87d53f03420ebe0672deae58d979/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:44:48.133216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bdde5-2d1f-4a87-a9bd-d7f10fb89bfc None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:48.133504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bdde5-2d1f-4a87-a9bd-d7f10fb89bfc None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:48.134407 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bdde5-2d1f-4a87-a9bd-d7f10fb89bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:48.159295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d29bdde5-2d1f-4a87-a9bd-d7f10fb89bfc None None] MFA Rules not processed for user `a61b87d53f03420ebe0672deae58d979`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:44:48.160518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d29bdde5-2d1f-4a87-a9bd-d7f10fb89bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:44:48.223542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 750/1502] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:44:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:44:48.236690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e075-1943-4f70-bd4d-6ca6773b0608 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:48.236978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e075-1943-4f70-bd4d-6ca6773b0608 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:48.237255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e075-1943-4f70-bd4d-6ca6773b0608 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:48.238615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 753/1503] 10.222.0.72 () {54 vars in 963 bytes} [Mon May 16 18:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:44:48.244408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc9908-5a56-48c4-8b66-ecd05282b064 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:48.244708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc9908-5a56-48c4-8b66-ecd05282b064 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:48.245019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc9908-5a56-48c4-8b66-ecd05282b064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:48.263208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-72dc9908-5a56-48c4-8b66-ecd05282b064 None None] MFA Rules not processed for user `eb06ac74276c4238b178a2467013348c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:44:48.264353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-72dc9908-5a56-48c4-8b66-ecd05282b064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:44:48.311657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 751/1504] 10.222.0.72 () {58 vars in 1060 bytes} [Mon May 16 18:44:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:44:48.319190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9e075-1943-4f70-bd4d-6ca6773b0608 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:44:48.330185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9e075-1943-4f70-bd4d-6ca6773b0608 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:44:48.333668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033117a4-ba88-4df0-b827-0ac11d51a334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:44:48.334301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033117a4-ba88-4df0-b827-0ac11d51a334 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:48.334581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033117a4-ba88-4df0-b827-0ac11d51a334 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:48.334855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033117a4-ba88-4df0-b827-0ac11d51a334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:48.343251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033117a4-ba88-4df0-b827-0ac11d51a334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:44:48.344837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033117a4-ba88-4df0-b827-0ac11d51a334 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:44:48.355180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 754/1505] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:44:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:44:48.396578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c608a-1a86-4b77-a32c-2894e95496e4 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:48.396898 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c608a-1a86-4b77-a32c-2894e95496e4 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:48.397176 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c608a-1a86-4b77-a32c-2894e95496e4 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:48.398484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 752/1506] 10.222.0.72 () {52 vars in 829 bytes} [Mon May 16 18:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:44:48.402044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033117a4-ba88-4df0-b827-0ac11d51a334 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:44:48.462540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033117a4-ba88-4df0-b827-0ac11d51a334 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:44:48.467260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:44:48.468154 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:48.468435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:48.468707 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] PATH_INFO: `/v3/users/a61b87d53f03420ebe0672deae58d979` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:48.469867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61b87d53f03420ebe0672deae58d979)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:44:48.470868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: WARNING py.warnings [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 18:44:48.470868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: warnings.warn(msg) May 16 18:44:48.470868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: May 16 18:44:48.472093 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:44:48.535758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61b87d53f03420ebe0672deae58d979'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:44:48.553698 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61b87d53f03420ebe0672deae58d979'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:44:48.554486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61b87d53f03420ebe0672deae58d979'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:44:48.563950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61b87d53f03420ebe0672deae58d979'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:44:48.575986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61b87d53f03420ebe0672deae58d979'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:44:48.581910 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 755/1507] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:44:48 2022] DELETE /identity/v3/users/a61b87d53f03420ebe0672deae58d979 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:44:48.586386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad7706-4fd9-4e94-b52a-4d9124c6997d None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:48.586672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad7706-4fd9-4e94-b52a-4d9124c6997d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:48.587073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad7706-4fd9-4e94-b52a-4d9124c6997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:48.604882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f1ad7706-4fd9-4e94-b52a-4d9124c6997d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:44:48.606059 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f1ad7706-4fd9-4e94-b52a-4d9124c6997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:44:48.668836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 753/1508] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:44:48.679223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:44:48.681284 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:44:48.738557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9c7c7-3c8d-4f51-8409-1caf3b503e25 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:44:48.742077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e8cf9-db1f-4fbb-8971-1cea311e6775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:44:48.742726 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8cf9-db1f-4fbb-8971-1cea311e6775 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:48.743006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8cf9-db1f-4fbb-8971-1cea311e6775 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:48.743304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8cf9-db1f-4fbb-8971-1cea311e6775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:48.751947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e8cf9-db1f-4fbb-8971-1cea311e6775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:44:48.753368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e8cf9-db1f-4fbb-8971-1cea311e6775 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:44:48.762340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 756/1509] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:44:49.114253 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad7706-4fd9-4e94-b52a-4d9124c6997d None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:44:49.115757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f1ad7706-4fd9-4e94-b52a-4d9124c6997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:44:49.129429 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad7706-4fd9-4e94-b52a-4d9124c6997d None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:44:49.136297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:44:49.137761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:44:49.138270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:44:49.138818 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] PATH_INFO: `/v3/projects/1a943f75527844979f37d5641cdfc369` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:44:49.151984 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a943f75527844979f37d5641cdfc369)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:44:49.153360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: WARNING py.warnings [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 18:44:49.153360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: warnings.warn(msg) May 16 18:44:49.153360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: May 16 18:44:49.154947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:44:49.214280 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a943f75527844979f37d5641cdfc369', 'request_id': 'req-c48218c6-25da-4926-af2f-e0f11b784cef'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:44:49.227847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a943f75527844979f37d5641cdfc369', 'request_id': 'req-c48218c6-25da-4926-af2f-e0f11b784cef'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:44:49.237581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a943f75527844979f37d5641cdfc369', 'request_id': 'req-c48218c6-25da-4926-af2f-e0f11b784cef'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:44:49.248250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] The token cache is being invalidate because project 1a943f75527844979f37d5641cdfc369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:44:49.248535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:44:49.249161 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c48218c6-25da-4926-af2f-e0f11b784cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:44:49.250778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 754/1510] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:44:49 2022] DELETE /identity/v3/projects/1a943f75527844979f37d5641cdfc369 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:46:28.014776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94314c-a2ae-4e7b-8539-e80200a524fa None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:28.015430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94314c-a2ae-4e7b-8539-e80200a524fa None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:28.015430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94314c-a2ae-4e7b-8539-e80200a524fa None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:28.017036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:46:28.022297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d4efc-2391-46be-8a48-bbf3a48ed2f7 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:28.022843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d4efc-2391-46be-8a48-bbf3a48ed2f7 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:28.022843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d4efc-2391-46be-8a48-bbf3a48ed2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:28.044659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-610d4efc-2391-46be-8a48-bbf3a48ed2f7 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:46:28.046637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-610d4efc-2391-46be-8a48-bbf3a48ed2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:28.126022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:46:28.309558 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94314c-a2ae-4e7b-8539-e80200a524fa None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:46:28.311394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-eb94314c-a2ae-4e7b-8539-e80200a524fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:28.420786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94314c-a2ae-4e7b-8539-e80200a524fa None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:46:28.429569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a1c32-4a4a-4e07-92c2-fbf0f2c9d0e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:46:28.430569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a1c32-4a4a-4e07-92c2-fbf0f2c9d0e7 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:28.431007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a1c32-4a4a-4e07-92c2-fbf0f2c9d0e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:28.431491 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a1c32-4a4a-4e07-92c2-fbf0f2c9d0e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:28.446487 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a1c32-4a4a-4e07-92c2-fbf0f2c9d0e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:46:28.449204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a1c32-4a4a-4e07-92c2-fbf0f2c9d0e7 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:46:28.466631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 758/1513] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:46:29.318579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e77b1e-589c-48a6-b57c-4f90236d1437 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:29.319451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e77b1e-589c-48a6-b57c-4f90236d1437 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:29.319745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e77b1e-589c-48a6-b57c-4f90236d1437 None None] PATH_INFO: `/v3` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:29.322006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 756/1514] 10.222.0.61 () {54 vars in 925 bytes} [Mon May 16 18:46:29 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:46:29.328580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b68055-9958-4ff3-bc80-6609f9e90a7a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:29.329155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b68055-9958-4ff3-bc80-6609f9e90a7a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:29.329155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b68055-9958-4ff3-bc80-6609f9e90a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:29.347432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c0b68055-9958-4ff3-bc80-6609f9e90a7a None None] MFA Rules not processed for user `443fd569cd1b4f6db86d575ed669e26a`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:46:29.348669 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c0b68055-9958-4ff3-bc80-6609f9e90a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:29.412369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 759/1515] 10.222.0.61 () {58 vars in 1015 bytes} [Mon May 16 18:46:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:46:29.441751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4e33d-9b9a-4b18-8d68-18baeb0c823a None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:29.442257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4e33d-9b9a-4b18-8d68-18baeb0c823a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:29.442791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4e33d-9b9a-4b18-8d68-18baeb0c823a None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:29.446056 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 757/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:46:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:46:29.452360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4625ae-b37a-481f-9a97-e6397d14c35a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:29.452811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4625ae-b37a-481f-9a97-e6397d14c35a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:29.453099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4625ae-b37a-481f-9a97-e6397d14c35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:29.479639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-3e4625ae-b37a-481f-9a97-e6397d14c35a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:46:29.480867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3e4625ae-b37a-481f-9a97-e6397d14c35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:29.488836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 760/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:46:29.659051 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4e33d-9b9a-4b18-8d68-18baeb0c823a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:46:29.676507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4e33d-9b9a-4b18-8d68-18baeb0c823a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:46:29.682695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8441-00a3-4ce1-a21e-f5f096dba400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:46:29.683353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8441-00a3-4ce1-a21e-f5f096dba400 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:29.683634 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8441-00a3-4ce1-a21e-f5f096dba400 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:29.683930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8441-00a3-4ce1-a21e-f5f096dba400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:29.692717 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8441-00a3-4ce1-a21e-f5f096dba400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:46:29.694271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8441-00a3-4ce1-a21e-f5f096dba400 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:46:29.704488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 758/1518] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:46:33.373757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5d967-11f8-46de-90f0-e5b745113f92 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:33.374410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5d967-11f8-46de-90f0-e5b745113f92 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:33.374410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5d967-11f8-46de-90f0-e5b745113f92 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:33.375978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 761/1519] 10.222.0.72 () {54 vars in 960 bytes} [Mon May 16 18:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:46:33.383231 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845e2b-0fac-4e24-aa03-d479cdd5ec3f None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:33.383781 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845e2b-0fac-4e24-aa03-d479cdd5ec3f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:33.383927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845e2b-0fac-4e24-aa03-d479cdd5ec3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:33.406919 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0c845e2b-0fac-4e24-aa03-d479cdd5ec3f None None] MFA Rules not processed for user `443fd569cd1b4f6db86d575ed669e26a`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:46:33.408180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0c845e2b-0fac-4e24-aa03-d479cdd5ec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:33.418805 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 759/1520] 10.222.0.72 () {58 vars in 1057 bytes} [Mon May 16 18:46:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:46:33.426289 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5d967-11f8-46de-90f0-e5b745113f92 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:46:33.443203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5d967-11f8-46de-90f0-e5b745113f92 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:46:33.448210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9f5f6-b099-4143-a35a-ab2e6c05ae5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443fd569cd1b4f6db86d575ed669e26a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:46:33.448859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9f5f6-b099-4143-a35a-ab2e6c05ae5e service placement] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:33.449143 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9f5f6-b099-4143-a35a-ab2e6c05ae5e service placement] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:33.449415 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9f5f6-b099-4143-a35a-ab2e6c05ae5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:33.457667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9f5f6-b099-4143-a35a-ab2e6c05ae5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:46:33.459244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9f5f6-b099-4143-a35a-ab2e6c05ae5e service placement] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:46:33.469416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 762/1521] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:46:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:46:41.027874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0501-bd3b-4086-9b80-0342c848bf04 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:41.028464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0501-bd3b-4086-9b80-0342c848bf04 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:41.028464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0501-bd3b-4086-9b80-0342c848bf04 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:41.029796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:46:41.034870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971472d6-ab0b-4898-ba00-41b87d929b65 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:41.035312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971472d6-ab0b-4898-ba00-41b87d929b65 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:41.035419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971472d6-ab0b-4898-ba00-41b87d929b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:41.053617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-971472d6-ab0b-4898-ba00-41b87d929b65 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:46:41.054945 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-971472d6-ab0b-4898-ba00-41b87d929b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:41.062734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:46:41.217353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0501-bd3b-4086-9b80-0342c848bf04 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:46:41.231332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0501-bd3b-4086-9b80-0342c848bf04 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:46:41.237136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c38e6-5ea3-4412-a9ab-b31187b03f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:46:41.237816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c38e6-5ea3-4412-a9ab-b31187b03f95 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:41.238099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c38e6-5ea3-4412-a9ab-b31187b03f95 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:41.238374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c38e6-5ea3-4412-a9ab-b31187b03f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:41.247485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c38e6-5ea3-4412-a9ab-b31187b03f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:46:41.249117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c38e6-5ea3-4412-a9ab-b31187b03f95 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:46:41.259388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 761/1524] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:46:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:46:42.154635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c3eed-b6b3-4a3c-8f53-4ef065539f13 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:42.155228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c3eed-b6b3-4a3c-8f53-4ef065539f13 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:42.155228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c3eed-b6b3-4a3c-8f53-4ef065539f13 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:42.156633 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 18:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:46:42.161362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ead1a-16ff-4ea2-a217-d67bb5836e54 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:42.161766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ead1a-16ff-4ea2-a217-d67bb5836e54 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:42.161915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ead1a-16ff-4ea2-a217-d67bb5836e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:42.179213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-5e2ead1a-16ff-4ea2-a217-d67bb5836e54 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:46:42.180968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5e2ead1a-16ff-4ea2-a217-d67bb5836e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:42.188662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 18:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:46:42.339608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c3eed-b6b3-4a3c-8f53-4ef065539f13 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:46:42.354353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c3eed-b6b3-4a3c-8f53-4ef065539f13 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:46:42.359659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d144d2-f1ae-4a36-bb1f-577a21c1c3a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:46:42.360393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d144d2-f1ae-4a36-bb1f-577a21c1c3a2 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:42.360670 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d144d2-f1ae-4a36-bb1f-577a21c1c3a2 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:42.360944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d144d2-f1ae-4a36-bb1f-577a21c1c3a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:42.369449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d144d2-f1ae-4a36-bb1f-577a21c1c3a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:46:42.371011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d144d2-f1ae-4a36-bb1f-577a21c1c3a2 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:46:42.380114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 765/1527] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:46:46.468422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df2ba0-5b10-46c3-84ef-820b131bf0fa None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:46.469041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df2ba0-5b10-46c3-84ef-820b131bf0fa None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:46.469041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df2ba0-5b10-46c3-84ef-820b131bf0fa None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:46.470369 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:46:46.475623 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3063afe-f194-41d9-a6f0-925347b51c14 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:46.476111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3063afe-f194-41d9-a6f0-925347b51c14 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:46.476215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3063afe-f194-41d9-a6f0-925347b51c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:46.494316 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-e3063afe-f194-41d9-a6f0-925347b51c14 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:46:46.495508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e3063afe-f194-41d9-a6f0-925347b51c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:46.503287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:46:46.539720 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df2ba0-5b10-46c3-84ef-820b131bf0fa None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:46:46.541443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-63df2ba0-5b10-46c3-84ef-820b131bf0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:46.596595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df2ba0-5b10-46c3-84ef-820b131bf0fa None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:46:46.600168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca6de-e560-4ef6-a023-fe6f61915a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:46:46.600834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca6de-e560-4ef6-a023-fe6f61915a36 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:46.601103 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca6de-e560-4ef6-a023-fe6f61915a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:46.601975 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca6de-e560-4ef6-a023-fe6f61915a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:46.610787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbca6de-e560-4ef6-a023-fe6f61915a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:46:46.612258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbca6de-e560-4ef6-a023-fe6f61915a36 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:46:46.621373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 764/1530] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:46:48.835224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891b52e-1dba-40dc-94cb-9bd402da063c None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:48.836553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891b52e-1dba-40dc-94cb-9bd402da063c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:48.836553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891b52e-1dba-40dc-94cb-9bd402da063c None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:48.838268 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:46:48.843754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3f252-02eb-4d7f-8818-15d0d322fbaa None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:48.844237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3f252-02eb-4d7f-8818-15d0d322fbaa None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:48.844351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3f252-02eb-4d7f-8818-15d0d322fbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:48.862841 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f0e3f252-02eb-4d7f-8818-15d0d322fbaa None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:46:48.864084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f0e3f252-02eb-4d7f-8818-15d0d322fbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:48.873084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:46:48.908489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891b52e-1dba-40dc-94cb-9bd402da063c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:46:48.919360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891b52e-1dba-40dc-94cb-9bd402da063c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:46:48.923194 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ee6a1-d1f1-4c85-a89e-e600cda4b001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:46:48.923897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ee6a1-d1f1-4c85-a89e-e600cda4b001 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:48.924157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ee6a1-d1f1-4c85-a89e-e600cda4b001 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:48.924432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ee6a1-d1f1-4c85-a89e-e600cda4b001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:48.934395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ee6a1-d1f1-4c85-a89e-e600cda4b001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:46:48.935484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ee6a1-d1f1-4c85-a89e-e600cda4b001 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:46:48.944712 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 768/1533] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:46:52.635498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbce9c-2d44-4163-b738-8ffecd515bec None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:52.636100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbce9c-2d44-4163-b738-8ffecd515bec None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:52.636100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbce9c-2d44-4163-b738-8ffecd515bec None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:52.637476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:46:52.642612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953649-43d7-4992-83e8-ec89b2e62db2 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:52.643072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953649-43d7-4992-83e8-ec89b2e62db2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:52.643182 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953649-43d7-4992-83e8-ec89b2e62db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:52.663200 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-47953649-43d7-4992-83e8-ec89b2e62db2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:46:52.665132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-47953649-43d7-4992-83e8-ec89b2e62db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:52.672856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:46:52.946831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbce9c-2d44-4163-b738-8ffecd515bec None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:46:52.948543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-79bbce9c-2d44-4163-b738-8ffecd515bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:53.004901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbce9c-2d44-4163-b738-8ffecd515bec None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:46:53.008932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd970048-8d50-4ffd-a940-c792905cdc2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:46:53.009580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd970048-8d50-4ffd-a940-c792905cdc2b service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:53.009869 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd970048-8d50-4ffd-a940-c792905cdc2b service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:53.010149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd970048-8d50-4ffd-a940-c792905cdc2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:53.018868 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd970048-8d50-4ffd-a940-c792905cdc2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:46:53.020332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd970048-8d50-4ffd-a940-c792905cdc2b service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:46:53.029911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 767/1536] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:46:55.325330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5934-65c1-467f-ae53-e0cdfe204a94 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:55.325895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5934-65c1-467f-ae53-e0cdfe204a94 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:55.325895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5934-65c1-467f-ae53-e0cdfe204a94 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:55.327174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 18:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:46:55.332300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bac9b-626a-4521-aaa8-472e3333048b None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:55.332706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bac9b-626a-4521-aaa8-472e3333048b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:55.332865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bac9b-626a-4521-aaa8-472e3333048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:55.351206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-bb3bac9b-626a-4521-aaa8-472e3333048b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:46:55.353111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-bb3bac9b-626a-4521-aaa8-472e3333048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:55.360830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 18:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:46:55.631065 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5934-65c1-467f-ae53-e0cdfe204a94 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:46:55.632758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-bada5934-65c1-467f-ae53-e0cdfe204a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:46:55.645709 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5934-65c1-467f-ae53-e0cdfe204a94 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:46:55.649812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a87eb-5155-4f48-8497-3286e03f75b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:46:55.650444 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a87eb-5155-4f48-8497-3286e03f75b4 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:46:55.650719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a87eb-5155-4f48-8497-3286e03f75b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:46:55.650994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a87eb-5155-4f48-8497-3286e03f75b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:46:55.659509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a87eb-5155-4f48-8497-3286e03f75b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:46:55.660968 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a87eb-5155-4f48-8497-3286e03f75b4 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:46:55.670228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 771/1539] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:25.848593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6df654-b0ee-4244-963b-62c2f9e27341 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:25.849255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6df654-b0ee-4244-963b-62c2f9e27341 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:25.849255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6df654-b0ee-4244-963b-62c2f9e27341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:25.885182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-6b6df654-b0ee-4244-963b-62c2f9e27341 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:25.886432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-6b6df654-b0ee-4244-963b-62c2f9e27341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:25.895408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 769/1540] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:25.906715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69bc01-48f6-4a34-93ae-13dfcc3ceac1 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:25.907333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69bc01-48f6-4a34-93ae-13dfcc3ceac1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:25.907333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69bc01-48f6-4a34-93ae-13dfcc3ceac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:25.935049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-5e69bc01-48f6-4a34-93ae-13dfcc3ceac1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:25.936423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5e69bc01-48f6-4a34-93ae-13dfcc3ceac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:25.952730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 772/1541] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:25.957856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6df654-b0ee-4244-963b-62c2f9e27341 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:25.974023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6df654-b0ee-4244-963b-62c2f9e27341 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:25.982120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c2a98-3966-44ae-a000-0a17d16ea3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:25.982808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c2a98-3966-44ae-a000-0a17d16ea3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:25.983093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c2a98-3966-44ae-a000-0a17d16ea3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:25.983371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c2a98-3966-44ae-a000-0a17d16ea3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:25.984157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c2a98-3966-44ae-a000-0a17d16ea3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:25.984469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c2a98-3966-44ae-a000-0a17d16ea3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:25.986127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c2a98-3966-44ae-a000-0a17d16ea3a9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.005974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 770/1542] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:26.014917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69bc01-48f6-4a34-93ae-13dfcc3ceac1 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.029082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69bc01-48f6-4a34-93ae-13dfcc3ceac1 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.035807 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165298a5-86d5-4d64-a8bf-fcaef8afd94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.036724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165298a5-86d5-4d64-a8bf-fcaef8afd94c admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.037212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165298a5-86d5-4d64-a8bf-fcaef8afd94c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.037788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165298a5-86d5-4d64-a8bf-fcaef8afd94c admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.038784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165298a5-86d5-4d64-a8bf-fcaef8afd94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.045263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165298a5-86d5-4d64-a8bf-fcaef8afd94c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.096257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 773/1543] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:26.101266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c2a98-3966-44ae-a000-0a17d16ea3a9 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.115159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c2a98-3966-44ae-a000-0a17d16ea3a9 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.133438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd4641-1315-48e7-880d-b8ed6940d7c3 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.134071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd4641-1315-48e7-880d-b8ed6940d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.134601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd4641-1315-48e7-880d-b8ed6940d7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.161529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-02bd4641-1315-48e7-880d-b8ed6940d7c3 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.163703 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-02bd4641-1315-48e7-880d-b8ed6940d7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.205383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bae43-45a1-4053-ba4d-470d1bab8771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.206074 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bae43-45a1-4053-ba4d-470d1bab8771 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.206361 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bae43-45a1-4053-ba4d-470d1bab8771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.206645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bae43-45a1-4053-ba4d-470d1bab8771 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.207346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bae43-45a1-4053-ba4d-470d1bab8771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.210264 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bae43-45a1-4053-ba4d-470d1bab8771 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.245045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 771/1544] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:26.249546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc3757-705c-4a28-b845-28cad0fdc77a None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.249900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc3757-705c-4a28-b845-28cad0fdc77a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.250201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc3757-705c-4a28-b845-28cad0fdc77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.276406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-20bc3757-705c-4a28-b845-28cad0fdc77a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.279078 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-20bc3757-705c-4a28-b845-28cad0fdc77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.296930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 774/1545] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:48:26.298711 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd4641-1315-48e7-880d-b8ed6940d7c3 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.307455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 772/1546] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.310602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306acdc0-8c30-47f5-81a6-73bacd695520 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.310896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306acdc0-8c30-47f5-81a6-73bacd695520 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.311182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306acdc0-8c30-47f5-81a6-73bacd695520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.321785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd4641-1315-48e7-880d-b8ed6940d7c3 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.342854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2702a91-82b6-440a-9758-65017a3a63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.343573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702a91-82b6-440a-9758-65017a3a63e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.343902 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702a91-82b6-440a-9758-65017a3a63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.344184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702a91-82b6-440a-9758-65017a3a63e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.344949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2702a91-82b6-440a-9758-65017a3a63e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.347534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2702a91-82b6-440a-9758-65017a3a63e3 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.354609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-306acdc0-8c30-47f5-81a6-73bacd695520 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.355760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-306acdc0-8c30-47f5-81a6-73bacd695520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.367786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 775/1547] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:26.370781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb621e-e9f5-40c9-838b-0ce4267761ef None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.373245 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb621e-e9f5-40c9-838b-0ce4267761ef None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.373590 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb621e-e9f5-40c9-838b-0ce4267761ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.378136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 773/1548] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.379687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7cb8b-ec34-4c6f-82ff-d62de2227c63 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.380816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7cb8b-ec34-4c6f-82ff-d62de2227c63 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.381106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7cb8b-ec34-4c6f-82ff-d62de2227c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.429201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-fcbb621e-e9f5-40c9-838b-0ce4267761ef None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.430480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-fcbb621e-e9f5-40c9-838b-0ce4267761ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.437002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-6ba7cb8b-ec34-4c6f-82ff-d62de2227c63 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.438204 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-6ba7cb8b-ec34-4c6f-82ff-d62de2227c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.449349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 776/1549] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.453270 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb621e-e9f5-40c9-838b-0ce4267761ef None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.458552 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 774/1550] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.460249 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734a8f-59a0-45e5-9642-fe3ec53373a3 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.463597 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734a8f-59a0-45e5-9642-fe3ec53373a3 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.464447 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734a8f-59a0-45e5-9642-fe3ec53373a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.477314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb621e-e9f5-40c9-838b-0ce4267761ef None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.489958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e593d59-ea21-4c6c-b16a-90353cde8be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.491664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e593d59-ea21-4c6c-b16a-90353cde8be7 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.494130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e593d59-ea21-4c6c-b16a-90353cde8be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.494130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e593d59-ea21-4c6c-b16a-90353cde8be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.494410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e593d59-ea21-4c6c-b16a-90353cde8be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.494677 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-e7734a8f-59a0-45e5-9642-fe3ec53373a3 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.496023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e7734a8f-59a0-45e5-9642-fe3ec53373a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.496161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e593d59-ea21-4c6c-b16a-90353cde8be7 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.504534 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 775/1551] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.505813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd45ac-dfd2-48b2-9233-01136dea6459 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.506171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd45ac-dfd2-48b2-9233-01136dea6459 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.506641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd45ac-dfd2-48b2-9233-01136dea6459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.509088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 777/1552] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:26.510519 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e593d59-ea21-4c6c-b16a-90353cde8be7 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.521947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e593d59-ea21-4c6c-b16a-90353cde8be7 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.526523 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-59bd45ac-dfd2-48b2-9233-01136dea6459 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.527267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2587a-25d9-4da0-a217-535d47f5e4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.527968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-59bd45ac-dfd2-48b2-9233-01136dea6459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.528099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2587a-25d9-4da0-a217-535d47f5e4ef admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.528445 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2587a-25d9-4da0-a217-535d47f5e4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.529068 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2587a-25d9-4da0-a217-535d47f5e4ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.529803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2587a-25d9-4da0-a217-535d47f5e4ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:26.530190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2587a-25d9-4da0-a217-535d47f5e4ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.531285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: WARNING py.warnings [None req-65b2587a-25d9-4da0-a217-535d47f5e4ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 18:48:26.531285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: warnings.warn(msg) May 16 18:48:26.531285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: May 16 18:48:26.532460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2587a-25d9-4da0-a217-535d47f5e4ef admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.536829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 776/1553] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.537861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd45ac-dfd2-48b2-9233-01136dea6459 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.548020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd45ac-dfd2-48b2-9233-01136dea6459 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.555773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 778/1554] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:26.555773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ac4c-2123-45ce-90f9-72b274b432a7 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.555773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ac4c-2123-45ce-90f9-72b274b432a7 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.555773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ac4c-2123-45ce-90f9-72b274b432a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.557902 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d49f19-bb05-41f3-9e81-5b67478b884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.558921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d49f19-bb05-41f3-9e81-5b67478b884c admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.559324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d49f19-bb05-41f3-9e81-5b67478b884c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.560462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d49f19-bb05-41f3-9e81-5b67478b884c admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.560462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d49f19-bb05-41f3-9e81-5b67478b884c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:26.560767 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d49f19-bb05-41f3-9e81-5b67478b884c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.562334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d49f19-bb05-41f3-9e81-5b67478b884c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.570970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-b563ac4c-2123-45ce-90f9-72b274b432a7 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.572332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b563ac4c-2123-45ce-90f9-72b274b432a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.582945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 777/1555] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:26.582945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed63407-1827-482c-a43b-7e43a2160ad8 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.582945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed63407-1827-482c-a43b-7e43a2160ad8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.582945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed63407-1827-482c-a43b-7e43a2160ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.590683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 779/1556] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.591221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563ac4c-2123-45ce-90f9-72b274b432a7 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.602131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563ac4c-2123-45ce-90f9-72b274b432a7 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.606561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-aed63407-1827-482c-a43b-7e43a2160ad8 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.606756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8532d65-40e0-4208-8d20-132bde48beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.607603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8532d65-40e0-4208-8d20-132bde48beb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.607732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-aed63407-1827-482c-a43b-7e43a2160ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.607917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8532d65-40e0-4208-8d20-132bde48beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.608342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8532d65-40e0-4208-8d20-132bde48beb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.609073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8532d65-40e0-4208-8d20-132bde48beb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:26.609379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8532d65-40e0-4208-8d20-132bde48beb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.610966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8532d65-40e0-4208-8d20-132bde48beb4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.618036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 778/1557] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.618925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed63407-1827-482c-a43b-7e43a2160ad8 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.624873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 780/1558] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:26.627533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b77be-5a77-4be4-9070-d22cbba32ede None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.627981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b77be-5a77-4be4-9070-d22cbba32ede None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.628364 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b77be-5a77-4be4-9070-d22cbba32ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.628478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed63407-1827-482c-a43b-7e43a2160ad8 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.635491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f530ed-8e5d-4601-b2a1-fb10749013a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.636409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f530ed-8e5d-4601-b2a1-fb10749013a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.636689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f530ed-8e5d-4601-b2a1-fb10749013a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.636959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f530ed-8e5d-4601-b2a1-fb10749013a4 admin admin] PATH_INFO: `/v3/projects/6c791776bb7c4aec99853df54b602fb1/users/e56e38fa6eef4cc281849c1ddf65ba3d/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.646688 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-3d0b77be-5a77-4be4-9070-d22cbba32ede None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.649009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3d0b77be-5a77-4be4-9070-d22cbba32ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.652204 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f530ed-8e5d-4601-b2a1-fb10749013a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c791776bb7c4aec99853df54b602fb1, user_id=e56e38fa6eef4cc281849c1ddf65ba3d, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.653232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: WARNING py.warnings [None req-85f530ed-8e5d-4601-b2a1-fb10749013a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 18:48:26.653232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: warnings.warn(msg) May 16 18:48:26.653232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: May 16 18:48:26.655186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f530ed-8e5d-4601-b2a1-fb10749013a4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.657169 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 781/1559] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.657938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b77be-5a77-4be4-9070-d22cbba32ede None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.668461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b77be-5a77-4be4-9070-d22cbba32ede None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.671972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 779/1560] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:26 2022] PUT /identity/v3/projects/6c791776bb7c4aec99853df54b602fb1/users/e56e38fa6eef4cc281849c1ddf65ba3d/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:26.672831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f530ed-8e5d-4601-b2a1-fb10749013a4 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.722499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78504ad-b4db-48d7-acfc-f752108400f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.723173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78504ad-b4db-48d7-acfc-f752108400f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.723459 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78504ad-b4db-48d7-acfc-f752108400f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.723753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78504ad-b4db-48d7-acfc-f752108400f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.724483 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78504ad-b4db-48d7-acfc-f752108400f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.727162 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78504ad-b4db-48d7-acfc-f752108400f5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.742066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f530ed-8e5d-4601-b2a1-fb10749013a4 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.749017 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a2df1-6d55-4779-aecc-fef99177e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.749686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a2df1-6d55-4779-aecc-fef99177e1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.749970 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a2df1-6d55-4779-aecc-fef99177e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.750250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a2df1-6d55-4779-aecc-fef99177e1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.750971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a2df1-6d55-4779-aecc-fef99177e1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.752028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: WARNING py.warnings [None req-386a2df1-6d55-4779-aecc-fef99177e1b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 18:48:26.752028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: warnings.warn(msg) May 16 18:48:26.752028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: May 16 18:48:26.753207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a2df1-6d55-4779-aecc-fef99177e1b8 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.753742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 782/1561] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:26.757334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c3bd-be7d-4414-a266-461503b91f65 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.757629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c3bd-be7d-4414-a266-461503b91f65 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.757912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c3bd-be7d-4414-a266-461503b91f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.776568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2875c3bd-be7d-4414-a266-461503b91f65 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.777754 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2875c3bd-be7d-4414-a266-461503b91f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.783809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 780/1562] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:26.783809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42198f46-fdd4-4e84-b32f-40a550a00247 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.783809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42198f46-fdd4-4e84-b32f-40a550a00247 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.783809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42198f46-fdd4-4e84-b32f-40a550a00247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.800883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-42198f46-fdd4-4e84-b32f-40a550a00247 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.802057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-42198f46-fdd4-4e84-b32f-40a550a00247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.839832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 783/1563] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.841267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1243-e53a-496f-a5e0-e8b3a9730788 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.841554 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1243-e53a-496f-a5e0-e8b3a9730788 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.841823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1243-e53a-496f-a5e0-e8b3a9730788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.860089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-455c1243-e53a-496f-a5e0-e8b3a9730788 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.861214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-455c1243-e53a-496f-a5e0-e8b3a9730788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.865589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 781/1564] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.868594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42198f46-fdd4-4e84-b32f-40a550a00247 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.872742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 784/1565] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:26.872742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c1243-e53a-496f-a5e0-e8b3a9730788 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.878432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42198f46-fdd4-4e84-b32f-40a550a00247 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.881299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c1243-e53a-496f-a5e0-e8b3a9730788 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.883692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adfab4-ec93-431f-9176-082d2107d017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.884382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfab4-ec93-431f-9176-082d2107d017 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.884667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfab4-ec93-431f-9176-082d2107d017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.884944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfab4-ec93-431f-9176-082d2107d017 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.885631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adfab4-ec93-431f-9176-082d2107d017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.886044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578c290-6b27-4d9d-9b4e-70179383a049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.886702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578c290-6b27-4d9d-9b4e-70179383a049 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.886987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578c290-6b27-4d9d-9b4e-70179383a049 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.887267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578c290-6b27-4d9d-9b4e-70179383a049 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.887531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adfab4-ec93-431f-9176-082d2107d017 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.888055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578c290-6b27-4d9d-9b4e-70179383a049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:26.888364 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578c290-6b27-4d9d-9b4e-70179383a049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.890023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578c290-6b27-4d9d-9b4e-70179383a049 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:26.902507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 785/1566] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:26.903934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4786234-317d-4713-954a-f9b5a5e609cc None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.904273 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4786234-317d-4713-954a-f9b5a5e609cc None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.904513 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4786234-317d-4713-954a-f9b5a5e609cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.914849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 782/1567] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:26.915972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adfab4-ec93-431f-9176-082d2107d017 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:26.938294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c4786234-317d-4713-954a-f9b5a5e609cc None None] MFA Rules not processed for user `e56e38fa6eef4cc281849c1ddf65ba3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:26.939524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c4786234-317d-4713-954a-f9b5a5e609cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:26.978582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adfab4-ec93-431f-9176-082d2107d017 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:26.983187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772494c-951b-42ac-b7d2-b321dd7dee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:26.983892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772494c-951b-42ac-b7d2-b321dd7dee82 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:26.984175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772494c-951b-42ac-b7d2-b321dd7dee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:26.984451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772494c-951b-42ac-b7d2-b321dd7dee82 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:26.985146 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772494c-951b-42ac-b7d2-b321dd7dee82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:26.987059 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772494c-951b-42ac-b7d2-b321dd7dee82 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.003814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 786/1568] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:27.008146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4786234-317d-4713-954a-f9b5a5e609cc None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.011408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 783/1569] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:26 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.011408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be750-53df-4b1b-914e-21f6f59f7db9 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.011408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be750-53df-4b1b-914e-21f6f59f7db9 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.011408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be750-53df-4b1b-914e-21f6f59f7db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.015757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4786234-317d-4713-954a-f9b5a5e609cc None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.020225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a003b-e309-4c52-8a2b-ab6be9a4d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.020889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a003b-e309-4c52-8a2b-ab6be9a4d03c admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.021166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a003b-e309-4c52-8a2b-ab6be9a4d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.021435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a003b-e309-4c52-8a2b-ab6be9a4d03c admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.022175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a003b-e309-4c52-8a2b-ab6be9a4d03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.023661 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: WARNING py.warnings [None req-d87a003b-e309-4c52-8a2b-ab6be9a4d03c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 18:48:27.023661 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: warnings.warn(msg) May 16 18:48:27.023661 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: May 16 18:48:27.024886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a003b-e309-4c52-8a2b-ab6be9a4d03c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.029428 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-5e4be750-53df-4b1b-914e-21f6f59f7db9 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:27.030624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5e4be750-53df-4b1b-914e-21f6f59f7db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:27.039481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 784/1570] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:27.040300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4be750-53df-4b1b-914e-21f6f59f7db9 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.045784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 787/1571] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.045784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a003b-e309-4c52-8a2b-ab6be9a4d03c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.050000 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4be750-53df-4b1b-914e-21f6f59f7db9 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.055496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b6823-5da9-40a7-84d9-5e699b9f8985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.056233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b6823-5da9-40a7-84d9-5e699b9f8985 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.056545 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b6823-5da9-40a7-84d9-5e699b9f8985 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.056972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b6823-5da9-40a7-84d9-5e699b9f8985 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.057709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b6823-5da9-40a7-84d9-5e699b9f8985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:27.058024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b6823-5da9-40a7-84d9-5e699b9f8985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.058662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a003b-e309-4c52-8a2b-ab6be9a4d03c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.059797 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b6823-5da9-40a7-84d9-5e699b9f8985 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.063290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143824c-3a95-4906-b8bb-3f8226cf6466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.063971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143824c-3a95-4906-b8bb-3f8226cf6466 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.064251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143824c-3a95-4906-b8bb-3f8226cf6466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.064522 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143824c-3a95-4906-b8bb-3f8226cf6466 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.065235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143824c-3a95-4906-b8bb-3f8226cf6466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:27.065535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143824c-3a95-4906-b8bb-3f8226cf6466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.067118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143824c-3a95-4906-b8bb-3f8226cf6466 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.072165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 785/1572] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:27.073015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b6823-5da9-40a7-84d9-5e699b9f8985 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.088060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 788/1573] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:27.088060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143824c-3a95-4906-b8bb-3f8226cf6466 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.088356 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b6823-5da9-40a7-84d9-5e699b9f8985 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.088356 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827bd27-7f55-4c5c-8179-da5a82d7990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.088356 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827bd27-7f55-4c5c-8179-da5a82d7990a admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.088654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827bd27-7f55-4c5c-8179-da5a82d7990a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.088752 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827bd27-7f55-4c5c-8179-da5a82d7990a admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.089701 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827bd27-7f55-4c5c-8179-da5a82d7990a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.091726 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827bd27-7f55-4c5c-8179-da5a82d7990a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.093937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143824c-3a95-4906-b8bb-3f8226cf6466 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.098555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2407bd-e77c-487e-b511-8722cc6018e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.099202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2407bd-e77c-487e-b511-8722cc6018e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.099481 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2407bd-e77c-487e-b511-8722cc6018e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.099786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2407bd-e77c-487e-b511-8722cc6018e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.101073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2407bd-e77c-487e-b511-8722cc6018e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.103056 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2407bd-e77c-487e-b511-8722cc6018e2 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.118945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 786/1574] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.119776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827bd27-7f55-4c5c-8179-da5a82d7990a admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.126202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 789/1575] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.126202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2407bd-e77c-487e-b511-8722cc6018e2 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.136006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2407bd-e77c-487e-b511-8722cc6018e2 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.181173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827bd27-7f55-4c5c-8179-da5a82d7990a admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.187404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61761f3-fbd7-4700-83a0-0a470133d53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.188117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61761f3-fbd7-4700-83a0-0a470133d53d admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.188401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61761f3-fbd7-4700-83a0-0a470133d53d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.188681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61761f3-fbd7-4700-83a0-0a470133d53d admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.189381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61761f3-fbd7-4700-83a0-0a470133d53d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.191305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61761f3-fbd7-4700-83a0-0a470133d53d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.194794 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eae5d-42b9-4ddc-84a7-d6242c22bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.195759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eae5d-42b9-4ddc-84a7-d6242c22bde1 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.196373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eae5d-42b9-4ddc-84a7-d6242c22bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.196651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eae5d-42b9-4ddc-84a7-d6242c22bde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.197419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eae5d-42b9-4ddc-84a7-d6242c22bde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.198993 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eae5d-42b9-4ddc-84a7-d6242c22bde1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.209866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 790/1576] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:27.211531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eae5d-42b9-4ddc-84a7-d6242c22bde1 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.221319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 787/1577] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.221319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61761f3-fbd7-4700-83a0-0a470133d53d admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.224126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eae5d-42b9-4ddc-84a7-d6242c22bde1 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.278738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a1ded-d4a8-4f61-929e-b7822f08f25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.279407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1ded-d4a8-4f61-929e-b7822f08f25a admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.279594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61761f3-fbd7-4700-83a0-0a470133d53d admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.279804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1ded-d4a8-4f61-929e-b7822f08f25a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.280021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1ded-d4a8-4f61-929e-b7822f08f25a admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.280748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a1ded-d4a8-4f61-929e-b7822f08f25a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:27.281057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a1ded-d4a8-4f61-929e-b7822f08f25a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.282648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a1ded-d4a8-4f61-929e-b7822f08f25a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.284265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465515e-0b1a-46c7-add9-1d60d71a2a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.284930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465515e-0b1a-46c7-add9-1d60d71a2a2a admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.285219 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465515e-0b1a-46c7-add9-1d60d71a2a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.285501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465515e-0b1a-46c7-add9-1d60d71a2a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.286234 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465515e-0b1a-46c7-add9-1d60d71a2a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.288454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465515e-0b1a-46c7-add9-1d60d71a2a2a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.293777 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 791/1578] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:27.301366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a1ded-d4a8-4f61-929e-b7822f08f25a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.301467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 788/1579] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:27.301467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465515e-0b1a-46c7-add9-1d60d71a2a2a admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.306752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a1ded-d4a8-4f61-929e-b7822f08f25a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.311167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465515e-0b1a-46c7-add9-1d60d71a2a2a admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.311492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe01754-efef-454f-a79b-4df69fa70b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.312183 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01754-efef-454f-a79b-4df69fa70b9b admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.312465 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01754-efef-454f-a79b-4df69fa70b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.312739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01754-efef-454f-a79b-4df69fa70b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.313428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe01754-efef-454f-a79b-4df69fa70b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.315307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe01754-efef-454f-a79b-4df69fa70b9b admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.315994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004897d-c6d7-4813-9c43-65f258235cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.316643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004897d-c6d7-4813-9c43-65f258235cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.316933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004897d-c6d7-4813-9c43-65f258235cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.317212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004897d-c6d7-4813-9c43-65f258235cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.317894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004897d-c6d7-4813-9c43-65f258235cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.320993 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004897d-c6d7-4813-9c43-65f258235cd2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.343465 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 792/1580] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.344637 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe01754-efef-454f-a79b-4df69fa70b9b admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.352289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 789/1581] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.352864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004897d-c6d7-4813-9c43-65f258235cd2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.404243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe01754-efef-454f-a79b-4df69fa70b9b admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.408765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb088e-0db8-41e4-b774-c7d8915185db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.409427 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb088e-0db8-41e4-b774-c7d8915185db admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.409708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb088e-0db8-41e4-b774-c7d8915185db admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.409977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb088e-0db8-41e4-b774-c7d8915185db admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.410661 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb088e-0db8-41e4-b774-c7d8915185db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.411911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004897d-c6d7-4813-9c43-65f258235cd2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.412715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb088e-0db8-41e4-b774-c7d8915185db admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.417380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe985b-e04a-4dca-8569-9de11392f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.418084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe985b-e04a-4dca-8569-9de11392f571 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.418486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe985b-e04a-4dca-8569-9de11392f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.418778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe985b-e04a-4dca-8569-9de11392f571 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.419526 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe985b-e04a-4dca-8569-9de11392f571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.421188 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe985b-e04a-4dca-8569-9de11392f571 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.432329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 790/1582] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:27.432975 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe985b-e04a-4dca-8569-9de11392f571 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.433287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 793/1583] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.434088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb088e-0db8-41e4-b774-c7d8915185db admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.445628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb088e-0db8-41e4-b774-c7d8915185db admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.445805 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe985b-e04a-4dca-8569-9de11392f571 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.450218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3c24d-9a10-4fec-9580-6fb7e7bcf1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.450878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3c24d-9a10-4fec-9580-6fb7e7bcf1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.451022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67391e1a-4562-4b12-97da-e26e2b78b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.451165 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3c24d-9a10-4fec-9580-6fb7e7bcf1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.451419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3c24d-9a10-4fec-9580-6fb7e7bcf1e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.451908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67391e1a-4562-4b12-97da-e26e2b78b519 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.452142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3c24d-9a10-4fec-9580-6fb7e7bcf1e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.452274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67391e1a-4562-4b12-97da-e26e2b78b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.452486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67391e1a-4562-4b12-97da-e26e2b78b519 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.453275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67391e1a-4562-4b12-97da-e26e2b78b519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.454029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3c24d-9a10-4fec-9580-6fb7e7bcf1e5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.454880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67391e1a-4562-4b12-97da-e26e2b78b519 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.466493 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 791/1584] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:27.467499 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67391e1a-4562-4b12-97da-e26e2b78b519 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.475201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 794/1585] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.476414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3c24d-9a10-4fec-9580-6fb7e7bcf1e5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.477566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67391e1a-4562-4b12-97da-e26e2b78b519 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.482305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fc538-df84-45d2-bf58-a9f91956f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.482964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fc538-df84-45d2-bf58-a9f91956f252 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.483246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fc538-df84-45d2-bf58-a9f91956f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.483523 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fc538-df84-45d2-bf58-a9f91956f252 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.484259 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fc538-df84-45d2-bf58-a9f91956f252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.486163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fc538-df84-45d2-bf58-a9f91956f252 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.486345 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3c24d-9a10-4fec-9580-6fb7e7bcf1e5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.491437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544fae4-1b7b-4dde-aac0-58d9ef0a7a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.492123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544fae4-1b7b-4dde-aac0-58d9ef0a7a0d admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.492400 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544fae4-1b7b-4dde-aac0-58d9ef0a7a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.492669 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544fae4-1b7b-4dde-aac0-58d9ef0a7a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.493391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544fae4-1b7b-4dde-aac0-58d9ef0a7a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.494948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544fae4-1b7b-4dde-aac0-58d9ef0a7a0d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.510518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 795/1586] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:27.510518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544fae4-1b7b-4dde-aac0-58d9ef0a7a0d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.518431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 792/1587] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.518431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fc538-df84-45d2-bf58-a9f91956f252 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.518686 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544fae4-1b7b-4dde-aac0-58d9ef0a7a0d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.573939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d89a8-d1b0-4a3a-b118-d9fb05a51fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.574612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d89a8-d1b0-4a3a-b118-d9fb05a51fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.575025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d89a8-d1b0-4a3a-b118-d9fb05a51fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.575276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d89a8-d1b0-4a3a-b118-d9fb05a51fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.576007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d89a8-d1b0-4a3a-b118-d9fb05a51fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.577907 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d89a8-d1b0-4a3a-b118-d9fb05a51fd3 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.578427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fc538-df84-45d2-bf58-a9f91956f252 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.582999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ec509-2e87-4595-9f74-ac14be76995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.583662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ec509-2e87-4595-9f74-ac14be76995a admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.583980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ec509-2e87-4595-9f74-ac14be76995a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.584256 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ec509-2e87-4595-9f74-ac14be76995a admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.585475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ec509-2e87-4595-9f74-ac14be76995a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.587374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ec509-2e87-4595-9f74-ac14be76995a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.601942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 796/1588] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.602873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d89a8-d1b0-4a3a-b118-d9fb05a51fd3 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.608468 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 793/1589] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.609361 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ec509-2e87-4595-9f74-ac14be76995a admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.614951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d89a8-d1b0-4a3a-b118-d9fb05a51fd3 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.619595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ec509-2e87-4595-9f74-ac14be76995a admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.620672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab23cf4-dbb4-4077-ab2b-baf76519d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.621336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab23cf4-dbb4-4077-ab2b-baf76519d026 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.621616 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab23cf4-dbb4-4077-ab2b-baf76519d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.621889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab23cf4-dbb4-4077-ab2b-baf76519d026 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.622645 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab23cf4-dbb4-4077-ab2b-baf76519d026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.624268 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab23cf4-dbb4-4077-ab2b-baf76519d026 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.624519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca5c07-a27e-4ce6-8b74-3e3d8cfc12d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.625173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca5c07-a27e-4ce6-8b74-3e3d8cfc12d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.625460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca5c07-a27e-4ce6-8b74-3e3d8cfc12d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.625742 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca5c07-a27e-4ce6-8b74-3e3d8cfc12d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.626469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca5c07-a27e-4ce6-8b74-3e3d8cfc12d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.628083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca5c07-a27e-4ce6-8b74-3e3d8cfc12d9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.634749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 797/1590] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:27.635642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab23cf4-dbb4-4077-ab2b-baf76519d026 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.639688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 794/1591] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:27.639688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca5c07-a27e-4ce6-8b74-3e3d8cfc12d9 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.646034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab23cf4-dbb4-4077-ab2b-baf76519d026 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.649149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca5c07-a27e-4ce6-8b74-3e3d8cfc12d9 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.651343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23264d34-91e4-49dc-8bc5-35d8a2341afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.652259 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264d34-91e4-49dc-8bc5-35d8a2341afa admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.652604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264d34-91e4-49dc-8bc5-35d8a2341afa admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.653706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b1929-b4a7-458f-911f-083e871d15a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.654409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b1929-b4a7-458f-911f-083e871d15a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.654643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b1929-b4a7-458f-911f-083e871d15a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.654923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b1929-b4a7-458f-911f-083e871d15a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.655650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b1929-b4a7-458f-911f-083e871d15a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.657265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b1929-b4a7-458f-911f-083e871d15a1 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.660405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264d34-91e4-49dc-8bc5-35d8a2341afa admin admin] PATH_INFO: `/v3/projects/e0a95c4f9d0540379820950741fbb7b7/users/63b448515d1c4e108996ba7e0fad9ac7/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.668837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 795/1592] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:27.669669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b1929-b4a7-458f-911f-083e871d15a1 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.679934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b1929-b4a7-458f-911f-083e871d15a1 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.680787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23264d34-91e4-49dc-8bc5-35d8a2341afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a95c4f9d0540379820950741fbb7b7, user_id=63b448515d1c4e108996ba7e0fad9ac7, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.683479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23264d34-91e4-49dc-8bc5-35d8a2341afa admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.684456 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3b948-73ac-4870-af95-c244a21f8f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.685350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b948-73ac-4870-af95-c244a21f8f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.685627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b948-73ac-4870-af95-c244a21f8f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.685899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b948-73ac-4870-af95-c244a21f8f6b admin admin] PATH_INFO: `/v3/projects/593c7b69cbad453499aacad0ad6e64ae/users/cd0d8acbe24d410690470e3d9d4882b1/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.696919 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 798/1593] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:27 2022] PUT /identity/v3/projects/e0a95c4f9d0540379820950741fbb7b7/users/63b448515d1c4e108996ba7e0fad9ac7/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:27.697715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23264d34-91e4-49dc-8bc5-35d8a2341afa admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.700837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3b948-73ac-4870-af95-c244a21f8f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=593c7b69cbad453499aacad0ad6e64ae, user_id=cd0d8acbe24d410690470e3d9d4882b1, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.704556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3b948-73ac-4870-af95-c244a21f8f6b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.718456 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 796/1594] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:27 2022] PUT /identity/v3/projects/593c7b69cbad453499aacad0ad6e64ae/users/cd0d8acbe24d410690470e3d9d4882b1/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:27.719274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3b948-73ac-4870-af95-c244a21f8f6b admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.760687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23264d34-91e4-49dc-8bc5-35d8a2341afa admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.780054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3b948-73ac-4870-af95-c244a21f8f6b admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.784582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7df92-345e-4ab1-8199-c929b80fe69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.785252 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7df92-345e-4ab1-8199-c929b80fe69f admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.785538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7df92-345e-4ab1-8199-c929b80fe69f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.785820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7df92-345e-4ab1-8199-c929b80fe69f admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.786552 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7df92-345e-4ab1-8199-c929b80fe69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.788759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7df92-345e-4ab1-8199-c929b80fe69f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.799110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 797/1595] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:27.799945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7df92-345e-4ab1-8199-c929b80fe69f admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.809915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7df92-345e-4ab1-8199-c929b80fe69f admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.814622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258e509-ab86-4bd4-9068-56c6e39f18d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.815275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258e509-ab86-4bd4-9068-56c6e39f18d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.815562 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258e509-ab86-4bd4-9068-56c6e39f18d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.815877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258e509-ab86-4bd4-9068-56c6e39f18d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.816605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258e509-ab86-4bd4-9068-56c6e39f18d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.818216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258e509-ab86-4bd4-9068-56c6e39f18d1 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.819275 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994c293-bc61-4943-b976-392fa01c4e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.820000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994c293-bc61-4943-b976-392fa01c4e82 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.820287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994c293-bc61-4943-b976-392fa01c4e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.820567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994c293-bc61-4943-b976-392fa01c4e82 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.821266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994c293-bc61-4943-b976-392fa01c4e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.823181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994c293-bc61-4943-b976-392fa01c4e82 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.828981 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 798/1596] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:27.829660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258e509-ab86-4bd4-9068-56c6e39f18d1 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.840469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258e509-ab86-4bd4-9068-56c6e39f18d1 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.846351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 799/1597] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:27.846351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994c293-bc61-4943-b976-392fa01c4e82 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.848281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dd2f0-978b-472f-aa8f-0ffee75c030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.849250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dd2f0-978b-472f-aa8f-0ffee75c030f admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.849592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dd2f0-978b-472f-aa8f-0ffee75c030f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.849875 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dd2f0-978b-472f-aa8f-0ffee75c030f admin admin] PATH_INFO: `/v3/projects/67cdad09821341cfa56bbc4642d2cd04/users/8928566ff693460f8243c43078a6a575/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.854644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994c293-bc61-4943-b976-392fa01c4e82 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.859219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdc475-5677-4334-bc76-00f5c1a92c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.859912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdc475-5677-4334-bc76-00f5c1a92c82 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.860198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdc475-5677-4334-bc76-00f5c1a92c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.860474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdc475-5677-4334-bc76-00f5c1a92c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.861201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdc475-5677-4334-bc76-00f5c1a92c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.862803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdc475-5677-4334-bc76-00f5c1a92c82 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.865479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dd2f0-978b-472f-aa8f-0ffee75c030f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cdad09821341cfa56bbc4642d2cd04, user_id=8928566ff693460f8243c43078a6a575, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.869137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dd2f0-978b-472f-aa8f-0ffee75c030f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.873239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 800/1598] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:27.874121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdc475-5677-4334-bc76-00f5c1a92c82 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.884555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdc475-5677-4334-bc76-00f5c1a92c82 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:27.884767 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 799/1599] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:27 2022] PUT /identity/v3/projects/67cdad09821341cfa56bbc4642d2cd04/users/8928566ff693460f8243c43078a6a575/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:27.886282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55756da6-f044-4939-9531-b2ace1d742c3 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.886579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55756da6-f044-4939-9531-b2ace1d742c3 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.886860 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55756da6-f044-4939-9531-b2ace1d742c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.912571 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-55756da6-f044-4939-9531-b2ace1d742c3 None None] MFA Rules not processed for user `63b448515d1c4e108996ba7e0fad9ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:27.913784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-55756da6-f044-4939-9531-b2ace1d742c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:27.946958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba2907-5194-4ed5-8dcc-513655cd3468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:27.947895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2907-5194-4ed5-8dcc-513655cd3468 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.948177 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2907-5194-4ed5-8dcc-513655cd3468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.948450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2907-5194-4ed5-8dcc-513655cd3468 admin admin] PATH_INFO: `/v3/projects/50dbfc64ba0f42ff96103b0e50f905fc/users/0bf4e0df48354a5ab9bd56c9638d998d/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.963446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba2907-5194-4ed5-8dcc-513655cd3468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50dbfc64ba0f42ff96103b0e50f905fc, user_id=0bf4e0df48354a5ab9bd56c9638d998d, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:27.966423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba2907-5194-4ed5-8dcc-513655cd3468 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:27.979319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 800/1600] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:27.980847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565640f-b28e-403f-aa8c-ab2f30a4c552 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:27.984019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565640f-b28e-403f-aa8c-ab2f30a4c552 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:27.984141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 801/1601] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:27 2022] PUT /identity/v3/projects/50dbfc64ba0f42ff96103b0e50f905fc/users/0bf4e0df48354a5ab9bd56c9638d998d/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:27.984246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565640f-b28e-403f-aa8c-ab2f30a4c552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:27.984347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba2907-5194-4ed5-8dcc-513655cd3468 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:27.998853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0565640f-b28e-403f-aa8c-ab2f30a4c552 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:28.000095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0565640f-b28e-403f-aa8c-ab2f30a4c552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:28.041575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba2907-5194-4ed5-8dcc-513655cd3468 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.046336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27650e5-cc2d-47d4-a066-7fa8770507c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.047008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27650e5-cc2d-47d4-a066-7fa8770507c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.047289 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27650e5-cc2d-47d4-a066-7fa8770507c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.047567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27650e5-cc2d-47d4-a066-7fa8770507c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.048417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27650e5-cc2d-47d4-a066-7fa8770507c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.050042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27650e5-cc2d-47d4-a066-7fa8770507c1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.059044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 801/1602] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:28.060006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565640f-b28e-403f-aa8c-ab2f30a4c552 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.060585 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 802/1603] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:28.061506 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27650e5-cc2d-47d4-a066-7fa8770507c1 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.071667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27650e5-cc2d-47d4-a066-7fa8770507c1 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.073584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565640f-b28e-403f-aa8c-ab2f30a4c552 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.076220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf4f99-586c-40d4-8bfa-08cf1493e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.076878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf4f99-586c-40d4-8bfa-08cf1493e981 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.077159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf4f99-586c-40d4-8bfa-08cf1493e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.077431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf4f99-586c-40d4-8bfa-08cf1493e981 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.078176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf4f99-586c-40d4-8bfa-08cf1493e981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.078288 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3c6bc-a1ad-408a-a7ed-67de69c84760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.078859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3c6bc-a1ad-408a-a7ed-67de69c84760 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.079143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3c6bc-a1ad-408a-a7ed-67de69c84760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.079417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3c6bc-a1ad-408a-a7ed-67de69c84760 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.079773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf4f99-586c-40d4-8bfa-08cf1493e981 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.080178 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3c6bc-a1ad-408a-a7ed-67de69c84760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.081775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3c6bc-a1ad-408a-a7ed-67de69c84760 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.090332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 803/1604] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:28.091109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf4f99-586c-40d4-8bfa-08cf1493e981 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.092384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 802/1605] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:28.095167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd5718-b940-4ddb-b8d6-cf5f5b45249b None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.095514 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd5718-b940-4ddb-b8d6-cf5f5b45249b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.095845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd5718-b940-4ddb-b8d6-cf5f5b45249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.102535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf4f99-586c-40d4-8bfa-08cf1493e981 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.107171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae85296-2583-4a9b-a92d-fa1464dc6aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.108076 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae85296-2583-4a9b-a92d-fa1464dc6aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.108356 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae85296-2583-4a9b-a92d-fa1464dc6aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.108636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae85296-2583-4a9b-a92d-fa1464dc6aa8 admin admin] PATH_INFO: `/v3/projects/59bc4430f77941289e052830c4b4cd55/users/c7477804e46c4af481dd4dd5b4c70a1f/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.112919 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-fdbd5718-b940-4ddb-b8d6-cf5f5b45249b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:28.114131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-fdbd5718-b940-4ddb-b8d6-cf5f5b45249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:28.122922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 803/1606] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:28.123200 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae85296-2583-4a9b-a92d-fa1464dc6aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bc4430f77941289e052830c4b4cd55, user_id=c7477804e46c4af481dd4dd5b4c70a1f, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.123522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd5718-b940-4ddb-b8d6-cf5f5b45249b None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.125871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae85296-2583-4a9b-a92d-fa1464dc6aa8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.133071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd5718-b940-4ddb-b8d6-cf5f5b45249b None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.139547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 804/1607] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:28 2022] PUT /identity/v3/projects/59bc4430f77941289e052830c4b4cd55/users/c7477804e46c4af481dd4dd5b4c70a1f/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:28.140582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae85296-2583-4a9b-a92d-fa1464dc6aa8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.188137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff3eb-4c7b-4166-b40e-3b6e044300d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.188723 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff3eb-4c7b-4166-b40e-3b6e044300d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.189009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff3eb-4c7b-4166-b40e-3b6e044300d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.189286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff3eb-4c7b-4166-b40e-3b6e044300d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.189988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eff3eb-4c7b-4166-b40e-3b6e044300d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.191938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eff3eb-4c7b-4166-b40e-3b6e044300d5 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.203376 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae85296-2583-4a9b-a92d-fa1464dc6aa8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.208003 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82816bb1-34c8-4f94-b116-e05066b5bb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.208667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82816bb1-34c8-4f94-b116-e05066b5bb2e admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.208946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82816bb1-34c8-4f94-b116-e05066b5bb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.209210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82816bb1-34c8-4f94-b116-e05066b5bb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.209970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82816bb1-34c8-4f94-b116-e05066b5bb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.211748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82816bb1-34c8-4f94-b116-e05066b5bb2e admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.217810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 804/1608] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:28 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:28.218612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff3eb-4c7b-4166-b40e-3b6e044300d5 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.224663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 805/1609] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:28.224663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82816bb1-34c8-4f94-b116-e05066b5bb2e admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.226500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-82816bb1-34c8-4f94-b116-e05066b5bb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:28.281891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82816bb1-34c8-4f94-b116-e05066b5bb2e admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.282736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff3eb-4c7b-4166-b40e-3b6e044300d5 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.287297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6b19b-e0ee-4587-aa64-b3cd6fd74370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.288429 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6b19b-e0ee-4587-aa64-b3cd6fd74370 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.288708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6b19b-e0ee-4587-aa64-b3cd6fd74370 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.288979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6b19b-e0ee-4587-aa64-b3cd6fd74370 admin admin] PATH_INFO: `/v3/projects/75d882994e2c443fb1d9104ccbfb8c7f/users/dab7aa55b2554d338cd76f34d03e1ef2/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.305362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6b19b-e0ee-4587-aa64-b3cd6fd74370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d882994e2c443fb1d9104ccbfb8c7f, user_id=dab7aa55b2554d338cd76f34d03e1ef2, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.308117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6b19b-e0ee-4587-aa64-b3cd6fd74370 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.321151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 805/1610] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:28 2022] PUT /identity/v3/projects/75d882994e2c443fb1d9104ccbfb8c7f/users/dab7aa55b2554d338cd76f34d03e1ef2/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:28.321995 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6b19b-e0ee-4587-aa64-b3cd6fd74370 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.330215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd306d0-00bf-402d-aa14-f406511f2459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.330880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd306d0-00bf-402d-aa14-f406511f2459 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.331162 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd306d0-00bf-402d-aa14-f406511f2459 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.331441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd306d0-00bf-402d-aa14-f406511f2459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.342139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd306d0-00bf-402d-aa14-f406511f2459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.343609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd306d0-00bf-402d-aa14-f406511f2459 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.354536 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 806/1611] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:28.355404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd306d0-00bf-402d-aa14-f406511f2459 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.365224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd306d0-00bf-402d-aa14-f406511f2459 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.386307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6b19b-e0ee-4587-aa64-b3cd6fd74370 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.391031 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf43ce-e24d-4522-82b0-66e03840c54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.391729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf43ce-e24d-4522-82b0-66e03840c54a admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.392054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf43ce-e24d-4522-82b0-66e03840c54a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.392338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf43ce-e24d-4522-82b0-66e03840c54a admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.393073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf43ce-e24d-4522-82b0-66e03840c54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.394684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf43ce-e24d-4522-82b0-66e03840c54a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.407748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 806/1612] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:28.407748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf43ce-e24d-4522-82b0-66e03840c54a admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.426130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9d57-c880-49cd-b6de-9790b046854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.427283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9d57-c880-49cd-b6de-9790b046854f admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.427595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9d57-c880-49cd-b6de-9790b046854f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.427926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9d57-c880-49cd-b6de-9790b046854f admin admin] PATH_INFO: `/v3/projects/b17a9621d46a4dec8cc4b8946abaa2c9/users/2e82aeba3f3b4304b0bb938aca6b92b8/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.446854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab9d57-c880-49cd-b6de-9790b046854f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17a9621d46a4dec8cc4b8946abaa2c9, user_id=2e82aeba3f3b4304b0bb938aca6b92b8, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.449762 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab9d57-c880-49cd-b6de-9790b046854f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.464973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 807/1613] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:28 2022] PUT /identity/v3/projects/b17a9621d46a4dec8cc4b8946abaa2c9/users/2e82aeba3f3b4304b0bb938aca6b92b8/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:28.466267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b7dbe-ab91-412f-84e5-6593e8db91f7 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.466554 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b7dbe-ab91-412f-84e5-6593e8db91f7 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.466829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b7dbe-ab91-412f-84e5-6593e8db91f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.468555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf43ce-e24d-4522-82b0-66e03840c54a admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.498646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8d3b7dbe-ab91-412f-84e5-6593e8db91f7 None None] MFA Rules not processed for user `c7477804e46c4af481dd4dd5b4c70a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:28.500274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8d3b7dbe-ab91-412f-84e5-6593e8db91f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:28.524909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0558e66-620f-4233-bc39-9a7396946126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.525775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0558e66-620f-4233-bc39-9a7396946126 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.526157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0558e66-620f-4233-bc39-9a7396946126 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.526870 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0558e66-620f-4233-bc39-9a7396946126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.573270 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 808/1614] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:28.574386 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b7dbe-ab91-412f-84e5-6593e8db91f7 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.596957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0558e66-620f-4233-bc39-9a7396946126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.598552 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0558e66-620f-4233-bc39-9a7396946126 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.611848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 807/1615] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:28.612762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0558e66-620f-4233-bc39-9a7396946126 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.623455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0558e66-620f-4233-bc39-9a7396946126 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.628582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbf73d-b401-43c2-b8df-e789230ee589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.629472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf73d-b401-43c2-b8df-e789230ee589 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.629754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf73d-b401-43c2-b8df-e789230ee589 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.630030 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbf73d-b401-43c2-b8df-e789230ee589 admin admin] PATH_INFO: `/v3/projects/50dbfc64ba0f42ff96103b0e50f905fc/users/0bf4e0df48354a5ab9bd56c9638d998d/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.632867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbf73d-b401-43c2-b8df-e789230ee589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50dbfc64ba0f42ff96103b0e50f905fc, user_id=0bf4e0df48354a5ab9bd56c9638d998d, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.635679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbf73d-b401-43c2-b8df-e789230ee589 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.642756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b7dbe-ab91-412f-84e5-6593e8db91f7 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.647571 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 808/1616] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:28 2022] PUT /identity/v3/projects/50dbfc64ba0f42ff96103b0e50f905fc/users/0bf4e0df48354a5ab9bd56c9638d998d/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:28.649751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01be10c-3b68-45e0-b329-c3c9653cb05d None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.650185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01be10c-3b68-45e0-b329-c3c9653cb05d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.650577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01be10c-3b68-45e0-b329-c3c9653cb05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.671612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-e01be10c-3b68-45e0-b329-c3c9653cb05d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:28.673011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e01be10c-3b68-45e0-b329-c3c9653cb05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:28.724627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b965ab-8a41-4c27-96e0-25cdbd4971f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.725981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b965ab-8a41-4c27-96e0-25cdbd4971f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.726267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b965ab-8a41-4c27-96e0-25cdbd4971f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.726542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b965ab-8a41-4c27-96e0-25cdbd4971f8 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.727314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b965ab-8a41-4c27-96e0-25cdbd4971f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.729362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b965ab-8a41-4c27-96e0-25cdbd4971f8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.762936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 809/1617] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:28 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:28.763720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b965ab-8a41-4c27-96e0-25cdbd4971f8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.787054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b965ab-8a41-4c27-96e0-25cdbd4971f8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.799923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3def79f-9789-4571-9a6c-e50e71ba2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.800919 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3def79f-9789-4571-9a6c-e50e71ba2a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.801239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3def79f-9789-4571-9a6c-e50e71ba2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.802400 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3def79f-9789-4571-9a6c-e50e71ba2a4d admin admin] PATH_INFO: `/v3/projects/332a575667ce44b6a4549a1c81ff4718/users/6661214f6806405d9cecb597d9349f4c/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.811608 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 809/1618] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:28.815457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95763d-e826-4056-89b3-69f25bed8739 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.815604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95763d-e826-4056-89b3-69f25bed8739 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.815856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95763d-e826-4056-89b3-69f25bed8739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.836771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3def79f-9789-4571-9a6c-e50e71ba2a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=332a575667ce44b6a4549a1c81ff4718, user_id=6661214f6806405d9cecb597d9349f4c, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.839913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3def79f-9789-4571-9a6c-e50e71ba2a4d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:28.845630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-df95763d-e826-4056-89b3-69f25bed8739 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:28.849059 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-df95763d-e826-4056-89b3-69f25bed8739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:28.861220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 810/1619] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:28.864481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95763d-e826-4056-89b3-69f25bed8739 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:28.868096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 810/1620] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:28 2022] PUT /identity/v3/projects/332a575667ce44b6a4549a1c81ff4718/users/6661214f6806405d9cecb597d9349f4c/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:28.870233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c399-9fcf-43de-929e-b2cb586f7515 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.870854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c399-9fcf-43de-929e-b2cb586f7515 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.871437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c399-9fcf-43de-929e-b2cb586f7515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.881786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95763d-e826-4056-89b3-69f25bed8739 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:28.920081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-0858c399-9fcf-43de-929e-b2cb586f7515 None None] MFA Rules not processed for user `0bf4e0df48354a5ab9bd56c9638d998d`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:28.921776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0858c399-9fcf-43de-929e-b2cb586f7515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:28.959239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524fbd3-514f-4030-b7c4-7784becacb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:28.961159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524fbd3-514f-4030-b7c4-7784becacb88 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:28.961333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524fbd3-514f-4030-b7c4-7784becacb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:28.961521 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524fbd3-514f-4030-b7c4-7784becacb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:28.962283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524fbd3-514f-4030-b7c4-7784becacb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:28.964575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524fbd3-514f-4030-b7c4-7784becacb88 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.001867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 811/1621] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:28 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:29.002756 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524fbd3-514f-4030-b7c4-7784becacb88 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.011348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 811/1622] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:29.012561 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c399-9fcf-43de-929e-b2cb586f7515 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.094187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524fbd3-514f-4030-b7c4-7784becacb88 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.101202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db298663-136b-43f2-9473-dfbde23d5264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.102698 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db298663-136b-43f2-9473-dfbde23d5264 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.103039 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db298663-136b-43f2-9473-dfbde23d5264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.103272 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db298663-136b-43f2-9473-dfbde23d5264 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.104955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db298663-136b-43f2-9473-dfbde23d5264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.106233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db298663-136b-43f2-9473-dfbde23d5264 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.109384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c399-9fcf-43de-929e-b2cb586f7515 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.122215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 812/1623] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:29.124602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef5045-a913-4fce-8950-5c814f5dd37e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.124948 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef5045-a913-4fce-8950-5c814f5dd37e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.125299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef5045-a913-4fce-8950-5c814f5dd37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.155137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-acef5045-a913-4fce-8950-5c814f5dd37e None None] MFA Rules not processed for user `6661214f6806405d9cecb597d9349f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:29.157785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-acef5045-a913-4fce-8950-5c814f5dd37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:29.196029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b45c-3d38-4936-86c6-5ec9e5ae153b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.197592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b45c-3d38-4936-86c6-5ec9e5ae153b service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.198147 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b45c-3d38-4936-86c6-5ec9e5ae153b service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.199146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b45c-3d38-4936-86c6-5ec9e5ae153b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.215495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9b45c-3d38-4936-86c6-5ec9e5ae153b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.218008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9b45c-3d38-4936-86c6-5ec9e5ae153b service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.233479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 812/1624] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:29.234562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b45c-3d38-4936-86c6-5ec9e5ae153b service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.246340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b45c-3d38-4936-86c6-5ec9e5ae153b service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.249555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 813/1625] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:29.250744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef5045-a913-4fce-8950-5c814f5dd37e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.252148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa1fb7-d347-4b98-bb53-32694a50a219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.252935 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa1fb7-d347-4b98-bb53-32694a50a219 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.253440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa1fb7-d347-4b98-bb53-32694a50a219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.253786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa1fb7-d347-4b98-bb53-32694a50a219 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.254554 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa1fb7-d347-4b98-bb53-32694a50a219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.257106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa1fb7-d347-4b98-bb53-32694a50a219 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.288148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 813/1626] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:29 2022] POST /identity/v3/users => generated 288 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:29.289258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa1fb7-d347-4b98-bb53-32694a50a219 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.304790 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa1fb7-d347-4b98-bb53-32694a50a219 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.308992 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebd942-b6d5-465a-9347-816519c5a692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.309670 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebd942-b6d5-465a-9347-816519c5a692 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.309963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebd942-b6d5-465a-9347-816519c5a692 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.310531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebd942-b6d5-465a-9347-816519c5a692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.321405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebd942-b6d5-465a-9347-816519c5a692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.323859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebd942-b6d5-465a-9347-816519c5a692 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.335790 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 814/1627] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:29.336489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebd942-b6d5-465a-9347-816519c5a692 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.336630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef5045-a913-4fce-8950-5c814f5dd37e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.341884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0df9a0-18be-4386-9d4c-25db7b7ef695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.343091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0df9a0-18be-4386-9d4c-25db7b7ef695 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.343384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0df9a0-18be-4386-9d4c-25db7b7ef695 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.343791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0df9a0-18be-4386-9d4c-25db7b7ef695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.346185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebd942-b6d5-465a-9347-816519c5a692 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.351444 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bba68-4178-4797-9436-283d35ef6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.352372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bba68-4178-4797-9436-283d35ef6b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.352654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bba68-4178-4797-9436-283d35ef6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.353014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bba68-4178-4797-9436-283d35ef6b55 admin admin] PATH_INFO: `/v3/projects/d890edccbcd249febd8f74c1ac9df73e/users/7065652977e946e883237deb23c557b7/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.368989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bba68-4178-4797-9436-283d35ef6b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d890edccbcd249febd8f74c1ac9df73e, user_id=7065652977e946e883237deb23c557b7, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.371807 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bba68-4178-4797-9436-283d35ef6b55 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.390088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 815/1628] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:29 2022] PUT /identity/v3/projects/d890edccbcd249febd8f74c1ac9df73e/users/7065652977e946e883237deb23c557b7/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:29.390088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103a1b-7337-4799-ba28-5ebbf76774b5 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.390088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103a1b-7337-4799-ba28-5ebbf76774b5 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.390088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08103a1b-7337-4799-ba28-5ebbf76774b5 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.391423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 816/1629] 10.222.0.72 () {54 vars in 961 bytes} [Mon May 16 18:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:48:29.392169 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08103a1b-7337-4799-ba28-5ebbf76774b5 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.418955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0df9a0-18be-4386-9d4c-25db7b7ef695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.420688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0df9a0-18be-4386-9d4c-25db7b7ef695 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.434129 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 814/1630] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:29.435295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0df9a0-18be-4386-9d4c-25db7b7ef695 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.451547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0df9a0-18be-4386-9d4c-25db7b7ef695 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.466643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08103a1b-7337-4799-ba28-5ebbf76774b5 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.480731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a949762-22ff-4966-97e5-2fe728d9f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.481652 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949762-22ff-4966-97e5-2fe728d9f9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.481857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949762-22ff-4966-97e5-2fe728d9f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.482053 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949762-22ff-4966-97e5-2fe728d9f9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.482802 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a949762-22ff-4966-97e5-2fe728d9f9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.484448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a949762-22ff-4966-97e5-2fe728d9f9b2 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.501460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 817/1631] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:29.501460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43177f-6225-480b-98f8-a1c6b69a19c5 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.501719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43177f-6225-480b-98f8-a1c6b69a19c5 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.502409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43177f-6225-480b-98f8-a1c6b69a19c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.531870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2a43177f-6225-480b-98f8-a1c6b69a19c5 None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:29.533251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2a43177f-6225-480b-98f8-a1c6b69a19c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:29.537847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd817-67c7-4e02-bfd9-9f9effd77164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.539275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd817-67c7-4e02-bfd9-9f9effd77164 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.539531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd817-67c7-4e02-bfd9-9f9effd77164 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.540019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd817-67c7-4e02-bfd9-9f9effd77164 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.541884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fd817-67c7-4e02-bfd9-9f9effd77164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.543921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fd817-67c7-4e02-bfd9-9f9effd77164 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.560096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 815/1632] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:29.561087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd817-67c7-4e02-bfd9-9f9effd77164 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.574448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd817-67c7-4e02-bfd9-9f9effd77164 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.580895 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21574086-c032-4de1-80b0-ed88bfa407d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.581923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21574086-c032-4de1-80b0-ed88bfa407d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.582292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21574086-c032-4de1-80b0-ed88bfa407d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.582577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21574086-c032-4de1-80b0-ed88bfa407d1 admin admin] PATH_INFO: `/v3/projects/f42444f9fe594040a606128d154e86b8/users/6676d0db32ae47ea925404f4943d83f6/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.612113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21574086-c032-4de1-80b0-ed88bfa407d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42444f9fe594040a606128d154e86b8, user_id=6676d0db32ae47ea925404f4943d83f6, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.618099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21574086-c032-4de1-80b0-ed88bfa407d1 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.638446 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 816/1633] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:29 2022] PUT /identity/v3/projects/f42444f9fe594040a606128d154e86b8/users/6676d0db32ae47ea925404f4943d83f6/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:29.639585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21574086-c032-4de1-80b0-ed88bfa407d1 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.647969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 818/1634] 10.222.0.72 () {58 vars in 1058 bytes} [Mon May 16 18:48:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:29.650205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43177f-6225-480b-98f8-a1c6b69a19c5 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.758451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43177f-6225-480b-98f8-a1c6b69a19c5 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.768991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21574086-c032-4de1-80b0-ed88bfa407d1 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.783489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21613426-8f23-4aea-a3c3-dec09e34f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.789074 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21613426-8f23-4aea-a3c3-dec09e34f806 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.789501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21613426-8f23-4aea-a3c3-dec09e34f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.789895 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21613426-8f23-4aea-a3c3-dec09e34f806 admin admin] PATH_INFO: `/v3/projects/d890edccbcd249febd8f74c1ac9df73e/users/7065652977e946e883237deb23c557b7/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.794639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21613426-8f23-4aea-a3c3-dec09e34f806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d890edccbcd249febd8f74c1ac9df73e, user_id=7065652977e946e883237deb23c557b7, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.810472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21613426-8f23-4aea-a3c3-dec09e34f806 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.840750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 817/1635] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:29 2022] PUT /identity/v3/projects/d890edccbcd249febd8f74c1ac9df73e/users/7065652977e946e883237deb23c557b7/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:29.842530 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21613426-8f23-4aea-a3c3-dec09e34f806 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.872112 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648633bc-6c1f-4b47-8320-29cde736b801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.872963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648633bc-6c1f-4b47-8320-29cde736b801 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.873581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648633bc-6c1f-4b47-8320-29cde736b801 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.874144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648633bc-6c1f-4b47-8320-29cde736b801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.951136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648633bc-6c1f-4b47-8320-29cde736b801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.952715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648633bc-6c1f-4b47-8320-29cde736b801 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:29.963270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21613426-8f23-4aea-a3c3-dec09e34f806 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:29.963876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 819/1636] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:29.965065 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648633bc-6c1f-4b47-8320-29cde736b801 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:29.987914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568970ed-4c1c-4ecc-b91c-c398a33e3cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:29.988613 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568970ed-4c1c-4ecc-b91c-c398a33e3cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:29.988899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568970ed-4c1c-4ecc-b91c-c398a33e3cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:29.989180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568970ed-4c1c-4ecc-b91c-c398a33e3cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:29.990033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568970ed-4c1c-4ecc-b91c-c398a33e3cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:29.991685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568970ed-4c1c-4ecc-b91c-c398a33e3cb0 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:30.031828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 818/1637] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:30.031828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b0571-72d7-4777-9141-619ca781e456 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:30.033248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b0571-72d7-4777-9141-619ca781e456 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:30.033560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b0571-72d7-4777-9141-619ca781e456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:30.093608 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-655b0571-72d7-4777-9141-619ca781e456 None None] MFA Rules not processed for user `7065652977e946e883237deb23c557b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:30.095015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-655b0571-72d7-4777-9141-619ca781e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:30.105667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648633bc-6c1f-4b47-8320-29cde736b801 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:30.239557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e6dea-e4aa-4bff-8920-debc86ca3fb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:30.240275 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e6dea-e4aa-4bff-8920-debc86ca3fb3 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:30.240564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e6dea-e4aa-4bff-8920-debc86ca3fb3 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:30.240875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e6dea-e4aa-4bff-8920-debc86ca3fb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:30.244192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 819/1638] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:30.245360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b0571-72d7-4777-9141-619ca781e456 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:30.279800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b0571-72d7-4777-9141-619ca781e456 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:30.295931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1aaafb-613b-45c5-8203-6c367e6f6c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:30.300664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aaafb-613b-45c5-8203-6c367e6f6c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:30.301329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aaafb-613b-45c5-8203-6c367e6f6c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:30.302452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aaafb-613b-45c5-8203-6c367e6f6c3d admin admin] PATH_INFO: `/v3/projects/f42444f9fe594040a606128d154e86b8/users/6676d0db32ae47ea925404f4943d83f6/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:30.307619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1aaafb-613b-45c5-8203-6c367e6f6c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42444f9fe594040a606128d154e86b8, user_id=6676d0db32ae47ea925404f4943d83f6, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:30.321664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1aaafb-613b-45c5-8203-6c367e6f6c3d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:30.327750 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e6dea-e4aa-4bff-8920-debc86ca3fb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:30.329641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e6dea-e4aa-4bff-8920-debc86ca3fb3 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:30.342655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 820/1639] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:30.350054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e6dea-e4aa-4bff-8920-debc86ca3fb3 service nova] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:30.380509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 820/1640] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:30 2022] PUT /identity/v3/projects/f42444f9fe594040a606128d154e86b8/users/6676d0db32ae47ea925404f4943d83f6/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:30.395804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda101a2-323e-4351-8df1-7b94b4a779e6 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:30.396238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda101a2-323e-4351-8df1-7b94b4a779e6 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:30.396676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda101a2-323e-4351-8df1-7b94b4a779e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:30.423019 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e6dea-e4aa-4bff-8920-debc86ca3fb3 service nova] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:30.447478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-eda101a2-323e-4351-8df1-7b94b4a779e6 None None] MFA Rules not processed for user `6676d0db32ae47ea925404f4943d83f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:30.449083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-eda101a2-323e-4351-8df1-7b94b4a779e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:30.561816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c858d01-bd1a-40e9-827b-05e012a2d233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:30.564621 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858d01-bd1a-40e9-827b-05e012a2d233 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:30.564909 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858d01-bd1a-40e9-827b-05e012a2d233 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:30.565191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c858d01-bd1a-40e9-827b-05e012a2d233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:30.650492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 821/1641] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:30.759315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c858d01-bd1a-40e9-827b-05e012a2d233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:30.763747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c858d01-bd1a-40e9-827b-05e012a2d233 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:30.789015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 821/1642] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:30.859125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda101a2-323e-4351-8df1-7b94b4a779e6 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:30.878182 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c576e-450b-4a62-9f12-fefe4ef04416 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:30.878573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c576e-450b-4a62-9f12-fefe4ef04416 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:30.878703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda101a2-323e-4351-8df1-7b94b4a779e6 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:30.879026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c576e-450b-4a62-9f12-fefe4ef04416 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:30.880844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 822/1643] 10.222.0.72 () {54 vars in 912 bytes} [Mon May 16 18:48:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:48:30.887092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21353874-f23a-493c-9c67-1cdff62e7101 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:30.887504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21353874-f23a-493c-9c67-1cdff62e7101 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:30.887943 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21353874-f23a-493c-9c67-1cdff62e7101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:30.891184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48656a-d5fd-4972-9991-8e6b381e6601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:30.891883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48656a-d5fd-4972-9991-8e6b381e6601 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:30.892164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48656a-d5fd-4972-9991-8e6b381e6601 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:30.892436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48656a-d5fd-4972-9991-8e6b381e6601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:30.914864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48656a-d5fd-4972-9991-8e6b381e6601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:30.917515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48656a-d5fd-4972-9991-8e6b381e6601 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:30.918326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-21353874-f23a-493c-9c67-1cdff62e7101 None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:30.923779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-21353874-f23a-493c-9c67-1cdff62e7101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:30.958097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 822/1644] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:31.045295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 823/1645] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:48:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:48:31.097006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48656a-d5fd-4972-9991-8e6b381e6601 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:31.108142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48656a-d5fd-4972-9991-8e6b381e6601 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:31.121153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6abdf7-877f-47aa-a8a8-eabd006c908d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:31.121965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6abdf7-877f-47aa-a8a8-eabd006c908d service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:31.122349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6abdf7-877f-47aa-a8a8-eabd006c908d service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:31.122758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6abdf7-877f-47aa-a8a8-eabd006c908d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:31.154256 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6abdf7-877f-47aa-a8a8-eabd006c908d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:31.155950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6abdf7-877f-47aa-a8a8-eabd006c908d service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:31.186915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 823/1646] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:31.715282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1ae2-b17e-4de5-b4ca-deb4436bb5d7 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:31.715948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1ae2-b17e-4de5-b4ca-deb4436bb5d7 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:31.716067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1ae2-b17e-4de5-b4ca-deb4436bb5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:31.774331 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-03ee1ae2-b17e-4de5-b4ca-deb4436bb5d7 None None] MFA Rules not processed for user `2e82aeba3f3b4304b0bb938aca6b92b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:31.776124 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-03ee1ae2-b17e-4de5-b4ca-deb4436bb5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:31.909568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 824/1647] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:31.923541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c244c8a-60c5-4239-b6b0-d019bdb4d4e5 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:31.923864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c244c8a-60c5-4239-b6b0-d019bdb4d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:31.924160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c244c8a-60c5-4239-b6b0-d019bdb4d4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:31.963149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-9c244c8a-60c5-4239-b6b0-d019bdb4d4e5 None None] MFA Rules not processed for user `2e82aeba3f3b4304b0bb938aca6b92b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:31.965016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9c244c8a-60c5-4239-b6b0-d019bdb4d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:31.982183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 824/1648] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:32.012370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bad7c-0a5d-4240-a7f5-b9b27c095e50 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:32.013786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bad7c-0a5d-4240-a7f5-b9b27c095e50 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:32.014311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bad7c-0a5d-4240-a7f5-b9b27c095e50 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:32.016372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 825/1649] 10.222.0.72 () {54 vars in 961 bytes} [Mon May 16 18:48:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:48:32.029386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317eb3-e28e-490f-9b97-e617d5110e43 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:32.030021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317eb3-e28e-490f-9b97-e617d5110e43 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:32.030692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f317eb3-e28e-490f-9b97-e617d5110e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:32.101120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1f317eb3-e28e-490f-9b97-e617d5110e43 None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:32.103187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1f317eb3-e28e-490f-9b97-e617d5110e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:32.164232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bad7c-0a5d-4240-a7f5-b9b27c095e50 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:32.166149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 825/1650] 10.222.0.72 () {58 vars in 1058 bytes} [Mon May 16 18:48:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:32.205682 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bad7c-0a5d-4240-a7f5-b9b27c095e50 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:32.223131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a70e52-e030-41bb-bbb6-7827fab8a08a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:32.223972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a70e52-e030-41bb-bbb6-7827fab8a08a service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:32.224373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a70e52-e030-41bb-bbb6-7827fab8a08a service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:32.224760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a70e52-e030-41bb-bbb6-7827fab8a08a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:32.246101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a70e52-e030-41bb-bbb6-7827fab8a08a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:32.251180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a70e52-e030-41bb-bbb6-7827fab8a08a service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:32.304006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 826/1651] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:32.783915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f317eb3-e28e-490f-9b97-e617d5110e43 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:32.786129 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a020b12-27a4-464d-acb9-59add6c5eb1a None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:32.786791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a020b12-27a4-464d-acb9-59add6c5eb1a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:32.786791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a020b12-27a4-464d-acb9-59add6c5eb1a None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:32.789707 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 827/1652] 10.222.0.72 () {54 vars in 912 bytes} [Mon May 16 18:48:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:48:32.802496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad07f2-7bed-4d00-b77a-98f18288ca29 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:32.802856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad07f2-7bed-4d00-b77a-98f18288ca29 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:32.803326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad07f2-7bed-4d00-b77a-98f18288ca29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:32.844422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2fad07f2-7bed-4d00-b77a-98f18288ca29 None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:32.847168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2fad07f2-7bed-4d00-b77a-98f18288ca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:32.870513 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 828/1653] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:48:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:48:32.886252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad07f2-7bed-4d00-b77a-98f18288ca29 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:32.888052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2fad07f2-7bed-4d00-b77a-98f18288ca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:32.981567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f317eb3-e28e-490f-9b97-e617d5110e43 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:32.994011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:32.995326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:32.995885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:32.996383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] PATH_INFO: `/v3/users/c7477804e46c4af481dd4dd5b4c70a1f` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:32.998172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7477804e46c4af481dd4dd5b4c70a1f)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:32.999439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: WARNING py.warnings [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 18:48:32.999439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: warnings.warn(msg) May 16 18:48:32.999439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: May 16 18:48:33.005569 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:33.047641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad07f2-7bed-4d00-b77a-98f18288ca29 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:33.062631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65996db3-9912-4eaa-afa5-8c84a4c4c8d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0e623c10804239a076fc6cde9b198d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:33.064869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65996db3-9912-4eaa-afa5-8c84a4c4c8d8 service glance] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:33.068036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65996db3-9912-4eaa-afa5-8c84a4c4c8d8 service glance] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:33.068580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65996db3-9912-4eaa-afa5-8c84a4c4c8d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:33.106556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65996db3-9912-4eaa-afa5-8c84a4c4c8d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:33.112811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65996db3-9912-4eaa-afa5-8c84a4c4c8d8 service glance] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:33.131054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7477804e46c4af481dd4dd5b4c70a1f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:33.136333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 829/1654] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:48:33.209295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7477804e46c4af481dd4dd5b4c70a1f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:33.210289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7477804e46c4af481dd4dd5b4c70a1f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:33.211491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7477804e46c4af481dd4dd5b4c70a1f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:33.235766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7477804e46c4af481dd4dd5b4c70a1f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:33.280535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 826/1655] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:48:32 2022] DELETE /identity/v3/users/c7477804e46c4af481dd4dd5b4c70a1f => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:33.285087 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0135f5-a478-43de-a2f6-a69825cb2aca None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:33.285375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0135f5-a478-43de-a2f6-a69825cb2aca None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:33.285650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0135f5-a478-43de-a2f6-a69825cb2aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:33.314758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-ed0135f5-a478-43de-a2f6-a69825cb2aca None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:33.317215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ed0135f5-a478-43de-a2f6-a69825cb2aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:33.567596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 830/1656] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:33.580950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:33.595883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:33.714691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190a2d4-6f0b-47db-86d0-c0461f5e4f4b admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:33.721009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4188b55-79ba-47b4-a116-e63f0fcb5e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:33.721780 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188b55-79ba-47b4-a116-e63f0fcb5e8b service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:33.722723 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188b55-79ba-47b4-a116-e63f0fcb5e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:33.723245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188b55-79ba-47b4-a116-e63f0fcb5e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:33.738669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4188b55-79ba-47b4-a116-e63f0fcb5e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:33.743180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4188b55-79ba-47b4-a116-e63f0fcb5e8b service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:33.763603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 827/1657] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:34.998990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0135f5-a478-43de-a2f6-a69825cb2aca None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:35.001096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4988fd6-364f-426d-8977-36222ab6e7be None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:35.001539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4988fd6-364f-426d-8977-36222ab6e7be None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:35.002398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4988fd6-364f-426d-8977-36222ab6e7be None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:35.004890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ed0135f5-a478-43de-a2f6-a69825cb2aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:35.008593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 828/1658] 10.222.0.72 () {54 vars in 912 bytes} [Mon May 16 18:48:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:48:35.016283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb007eb5-fe1a-4b69-9fb2-c1ec9c6e6e88 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:35.017483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb007eb5-fe1a-4b69-9fb2-c1ec9c6e6e88 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:35.017982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb007eb5-fe1a-4b69-9fb2-c1ec9c6e6e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:35.037786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0135f5-a478-43de-a2f6-a69825cb2aca None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:35.054603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541dfb0-61bd-4b5c-b4c1-bf4556404db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:35.055560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541dfb0-61bd-4b5c-b4c1-bf4556404db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:35.055909 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541dfb0-61bd-4b5c-b4c1-bf4556404db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:35.057747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541dfb0-61bd-4b5c-b4c1-bf4556404db5 admin admin] PATH_INFO: `/v3/users/63b448515d1c4e108996ba7e0fad9ac7` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:35.059507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541dfb0-61bd-4b5c-b4c1-bf4556404db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b448515d1c4e108996ba7e0fad9ac7)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:35.073466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541dfb0-61bd-4b5c-b4c1-bf4556404db5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:35.111623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-bb007eb5-fe1a-4b69-9fb2-c1ec9c6e6e88 None None] MFA Rules not processed for user `c22a0fc8a3914f7fb3356a84827db326`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:35.117601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-bb007eb5-fe1a-4b69-9fb2-c1ec9c6e6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:35.140828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 829/1659] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:48:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:48:35.189792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb007eb5-fe1a-4b69-9fb2-c1ec9c6e6e88 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:35.192563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-bb007eb5-fe1a-4b69-9fb2-c1ec9c6e6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:35.230159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-4541dfb0-61bd-4b5c-b4c1-bf4556404db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b448515d1c4e108996ba7e0fad9ac7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:35.243195 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb007eb5-fe1a-4b69-9fb2-c1ec9c6e6e88 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:35.263745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41728dbf-b4f4-401b-b7f5-28188ae2c971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:35.264987 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41728dbf-b4f4-401b-b7f5-28188ae2c971 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:35.265566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41728dbf-b4f4-401b-b7f5-28188ae2c971 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:35.266303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41728dbf-b4f4-401b-b7f5-28188ae2c971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:35.267641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-4541dfb0-61bd-4b5c-b4c1-bf4556404db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b448515d1c4e108996ba7e0fad9ac7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:35.269287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-4541dfb0-61bd-4b5c-b4c1-bf4556404db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b448515d1c4e108996ba7e0fad9ac7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:35.284950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-4541dfb0-61bd-4b5c-b4c1-bf4556404db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b448515d1c4e108996ba7e0fad9ac7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:35.294496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41728dbf-b4f4-401b-b7f5-28188ae2c971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:35.299551 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41728dbf-b4f4-401b-b7f5-28188ae2c971 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:35.302405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-4541dfb0-61bd-4b5c-b4c1-bf4556404db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b448515d1c4e108996ba7e0fad9ac7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:35.321420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 831/1660] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:48:34 2022] DELETE /identity/v3/users/63b448515d1c4e108996ba7e0fad9ac7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:35.323242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037a85f-c44a-4112-8172-9a41c900be10 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:35.323681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037a85f-c44a-4112-8172-9a41c900be10 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:35.324126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037a85f-c44a-4112-8172-9a41c900be10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:35.340254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 830/1661] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:35.346882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-1037a85f-c44a-4112-8172-9a41c900be10 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:35.348474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1037a85f-c44a-4112-8172-9a41c900be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:35.449190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 832/1662] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:35.479333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41728dbf-b4f4-401b-b7f5-28188ae2c971 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:35.486606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41728dbf-b4f4-401b-b7f5-28188ae2c971 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:35.876604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4169-1eb8-4e39-8dc8-c3b8988cb843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:35.877239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4169-1eb8-4e39-8dc8-c3b8988cb843 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:35.877544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4169-1eb8-4e39-8dc8-c3b8988cb843 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:35.877826 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4169-1eb8-4e39-8dc8-c3b8988cb843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:35.899742 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b4169-1eb8-4e39-8dc8-c3b8988cb843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:35.901258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b4169-1eb8-4e39-8dc8-c3b8988cb843 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:35.926841 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 831/1663] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:36.619491 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037a85f-c44a-4112-8172-9a41c900be10 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:36.620998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1037a85f-c44a-4112-8172-9a41c900be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:36.646435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037a85f-c44a-4112-8172-9a41c900be10 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:36.663546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:36.664422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:36.666324 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:36.666662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] PATH_INFO: `/v3/projects/59bc4430f77941289e052830c4b4cd55` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:36.668169 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59bc4430f77941289e052830c4b4cd55)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:36.669792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: WARNING py.warnings [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 18:48:36.669792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: warnings.warn(msg) May 16 18:48:36.669792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: May 16 18:48:36.671200 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:36.845465 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59bc4430f77941289e052830c4b4cd55', 'request_id': 'req-ece5edc9-b462-4402-93ff-e563fdf6613c'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:36.885885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59bc4430f77941289e052830c4b4cd55', 'request_id': 'req-ece5edc9-b462-4402-93ff-e563fdf6613c'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:36.924449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59bc4430f77941289e052830c4b4cd55', 'request_id': 'req-ece5edc9-b462-4402-93ff-e563fdf6613c'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:36.997113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] The token cache is being invalidate because project 59bc4430f77941289e052830c4b4cd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:48:36.997635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:36.999768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:37.005079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 833/1664] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:48:36 2022] DELETE /identity/v3/projects/59bc4430f77941289e052830c4b4cd55 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:37.010059 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4169-1eb8-4e39-8dc8-c3b8988cb843 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:37.030889 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4169-1eb8-4e39-8dc8-c3b8988cb843 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:37.198739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce4c8d-5b66-4ecf-a632-7afd0ea3eed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:37.203652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce4c8d-5b66-4ecf-a632-7afd0ea3eed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:37.203972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce4c8d-5b66-4ecf-a632-7afd0ea3eed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:37.206419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce4c8d-5b66-4ecf-a632-7afd0ea3eed1 admin admin] PATH_INFO: `/v3/users/6676d0db32ae47ea925404f4943d83f6` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:37.207949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce4c8d-5b66-4ecf-a632-7afd0ea3eed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6676d0db32ae47ea925404f4943d83f6)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:37.215142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce4c8d-5b66-4ecf-a632-7afd0ea3eed1 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:37.260582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:37.266633 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:37.318168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5edc9-b462-4402-93ff-e563fdf6613c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:37.339784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:37.352071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:37.353063 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:37.353694 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] PATH_INFO: `/v3/projects/e0a95c4f9d0540379820950741fbb7b7` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:37.357304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a95c4f9d0540379820950741fbb7b7)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:37.389460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:37.409220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-cdce4c8d-5b66-4ecf-a632-7afd0ea3eed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6676d0db32ae47ea925404f4943d83f6'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:37.441315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-cdce4c8d-5b66-4ecf-a632-7afd0ea3eed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6676d0db32ae47ea925404f4943d83f6'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:37.442964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-cdce4c8d-5b66-4ecf-a632-7afd0ea3eed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6676d0db32ae47ea925404f4943d83f6'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:37.444516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-cdce4c8d-5b66-4ecf-a632-7afd0ea3eed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6676d0db32ae47ea925404f4943d83f6'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:37.464616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-cdce4c8d-5b66-4ecf-a632-7afd0ea3eed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6676d0db32ae47ea925404f4943d83f6'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:37.499221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 832/1665] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:48:37 2022] DELETE /identity/v3/users/6676d0db32ae47ea925404f4943d83f6 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:37.556737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed24d61-3b7d-4dd2-b18e-05dcfa2c14fb None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:37.556998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed24d61-3b7d-4dd2-b18e-05dcfa2c14fb None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:37.557276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed24d61-3b7d-4dd2-b18e-05dcfa2c14fb None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:37.558675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 833/1666] 10.222.0.72 () {54 vars in 960 bytes} [Mon May 16 18:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:48:37.603223 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9fba8-aa46-4295-994d-d37f1382d5eb None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:37.603934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9fba8-aa46-4295-994d-d37f1382d5eb None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:37.604403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9fba8-aa46-4295-994d-d37f1382d5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:37.628258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a95c4f9d0540379820950741fbb7b7', 'request_id': 'req-19c521d4-051e-4d02-b0a0-00ba55c79b54'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:37.650290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a95c4f9d0540379820950741fbb7b7', 'request_id': 'req-19c521d4-051e-4d02-b0a0-00ba55c79b54'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:37.658377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-83a9fba8-aa46-4295-994d-d37f1382d5eb None None] MFA Rules not processed for user `443fd569cd1b4f6db86d575ed669e26a`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:37.660072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-83a9fba8-aa46-4295-994d-d37f1382d5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:37.675366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a95c4f9d0540379820950741fbb7b7', 'request_id': 'req-19c521d4-051e-4d02-b0a0-00ba55c79b54'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:37.726878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] The token cache is being invalidate because project e0a95c4f9d0540379820950741fbb7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:48:37.727408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:37.728854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:37.737717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 834/1667] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:48:37 2022] DELETE /identity/v3/projects/e0a95c4f9d0540379820950741fbb7b7 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:37.739577 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:37.748751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:37.920462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 834/1668] 10.222.0.72 () {58 vars in 1057 bytes} [Mon May 16 18:48:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 16 18:48:37.929988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9fba8-aa46-4295-994d-d37f1382d5eb None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:37.950262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9fba8-aa46-4295-994d-d37f1382d5eb None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:37.974536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576cc2b-c4ae-4940-bc0c-3637cf65a579 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443fd569cd1b4f6db86d575ed669e26a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:37.975990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576cc2b-c4ae-4940-bc0c-3637cf65a579 service placement] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:37.976628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576cc2b-c4ae-4940-bc0c-3637cf65a579 service placement] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:37.977009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576cc2b-c4ae-4940-bc0c-3637cf65a579 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:37.981467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1576cc2b-c4ae-4940-bc0c-3637cf65a579 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:37.985649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c521d4-051e-4d02-b0a0-00ba55c79b54 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:38.014818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d65a9-03f1-4239-b4cd-8e6653a513ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:38.015908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d65a9-03f1-4239-b4cd-8e6653a513ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:38.022287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d65a9-03f1-4239-b4cd-8e6653a513ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:38.023590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576cc2b-c4ae-4940-bc0c-3637cf65a579 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:38.024720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d65a9-03f1-4239-b4cd-8e6653a513ec admin admin] PATH_INFO: `/v3/users/7065652977e946e883237deb23c557b7` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:38.032373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576cc2b-c4ae-4940-bc0c-3637cf65a579 service placement] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:38.033444 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d65a9-03f1-4239-b4cd-8e6653a513ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7065652977e946e883237deb23c557b7)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:38.035613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d65a9-03f1-4239-b4cd-8e6653a513ec admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:38.070458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 835/1669] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:38.130869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-233d65a9-03f1-4239-b4cd-8e6653a513ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7065652977e946e883237deb23c557b7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:38.149290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-233d65a9-03f1-4239-b4cd-8e6653a513ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7065652977e946e883237deb23c557b7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:38.150344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-233d65a9-03f1-4239-b4cd-8e6653a513ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7065652977e946e883237deb23c557b7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:38.165089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-233d65a9-03f1-4239-b4cd-8e6653a513ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7065652977e946e883237deb23c557b7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:38.182430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-233d65a9-03f1-4239-b4cd-8e6653a513ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7065652977e946e883237deb23c557b7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:38.215496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 835/1670] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:48:37 2022] DELETE /identity/v3/users/7065652977e946e883237deb23c557b7 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:39.638388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576cc2b-c4ae-4940-bc0c-3637cf65a579 service placement] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:39.645053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1576cc2b-c4ae-4940-bc0c-3637cf65a579 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:39.723828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576cc2b-c4ae-4940-bc0c-3637cf65a579 service placement] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:39.839355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:39.840295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:39.840561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:39.841161 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] PATH_INFO: `/v3/projects/f42444f9fe594040a606128d154e86b8` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:39.842755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42444f9fe594040a606128d154e86b8)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:39.846971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:40.031361 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42444f9fe594040a606128d154e86b8', 'request_id': 'req-a0b4cc90-6351-435c-8999-5f66fac3dbe9'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:40.044504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42444f9fe594040a606128d154e86b8', 'request_id': 'req-a0b4cc90-6351-435c-8999-5f66fac3dbe9'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:40.065441 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42444f9fe594040a606128d154e86b8', 'request_id': 'req-a0b4cc90-6351-435c-8999-5f66fac3dbe9'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:40.083585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] The token cache is being invalidate because project f42444f9fe594040a606128d154e86b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:48:40.091250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:40.092710 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a0b4cc90-6351-435c-8999-5f66fac3dbe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:40.096942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 836/1671] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:48:39 2022] DELETE /identity/v3/projects/f42444f9fe594040a606128d154e86b8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:40.104187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626a67-79b4-4211-9fa1-e54fe89fe2bd None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:40.104937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626a67-79b4-4211-9fa1-e54fe89fe2bd None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:40.104937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626a67-79b4-4211-9fa1-e54fe89fe2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:40.153197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a3626a67-79b4-4211-9fa1-e54fe89fe2bd None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:40.154588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a3626a67-79b4-4211-9fa1-e54fe89fe2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:40.343007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 836/1672] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:40.357532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891508f-4c2b-43a9-950d-880e767e77ac None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:40.357818 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891508f-4c2b-43a9-950d-880e767e77ac None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:40.358106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891508f-4c2b-43a9-950d-880e767e77ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:40.395570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-8891508f-4c2b-43a9-950d-880e767e77ac None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:40.397422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-8891508f-4c2b-43a9-950d-880e767e77ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:40.426482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 837/1673] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:40.432342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626a67-79b4-4211-9fa1-e54fe89fe2bd None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:40.442673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626a67-79b4-4211-9fa1-e54fe89fe2bd None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:40.465630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f26e1b-ac0a-46b3-bf75-305313f2bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:40.466864 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f26e1b-ac0a-46b3-bf75-305313f2bf46 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:40.467348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f26e1b-ac0a-46b3-bf75-305313f2bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:40.468897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f26e1b-ac0a-46b3-bf75-305313f2bf46 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:40.470453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f26e1b-ac0a-46b3-bf75-305313f2bf46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:40.471215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f26e1b-ac0a-46b3-bf75-305313f2bf46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:40.475151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f26e1b-ac0a-46b3-bf75-305313f2bf46 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:40.482062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891508f-4c2b-43a9-950d-880e767e77ac None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:40.484279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-8891508f-4c2b-43a9-950d-880e767e77ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:40.502493 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891508f-4c2b-43a9-950d-880e767e77ac None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:40.519481 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 837/1674] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:40.519914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:40.521004 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:40.521136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f26e1b-ac0a-46b3-bf75-305313f2bf46 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:40.522144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:40.522606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] PATH_INFO: `/v3/projects/d890edccbcd249febd8f74c1ac9df73e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:40.525188 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d890edccbcd249febd8f74c1ac9df73e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:40.527420 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:40.556050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f26e1b-ac0a-46b3-bf75-305313f2bf46 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:40.571656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769901d0-cdaf-47ca-b770-5310d97a051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:40.572769 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769901d0-cdaf-47ca-b770-5310d97a051c admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:40.573230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769901d0-cdaf-47ca-b770-5310d97a051c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:40.573684 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769901d0-cdaf-47ca-b770-5310d97a051c admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:40.578095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769901d0-cdaf-47ca-b770-5310d97a051c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:40.581639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769901d0-cdaf-47ca-b770-5310d97a051c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:40.681493 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd890edccbcd249febd8f74c1ac9df73e', 'request_id': 'req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:40.701670 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd890edccbcd249febd8f74c1ac9df73e', 'request_id': 'req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:40.718403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd890edccbcd249febd8f74c1ac9df73e', 'request_id': 'req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:40.736596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] The token cache is being invalidate because project d890edccbcd249febd8f74c1ac9df73e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:48:40.736889 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:40.744348 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0a8c0ea7-37c0-4e64-a94d-e1e0c773c6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:40.746758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 838/1675] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:48:40 2022] DELETE /identity/v3/projects/d890edccbcd249febd8f74c1ac9df73e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:48:40.753302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36403-5cc0-4ca0-903f-edd8eb7193f5 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:40.753852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36403-5cc0-4ca0-903f-edd8eb7193f5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:40.754271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36403-5cc0-4ca0-903f-edd8eb7193f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:40.789041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-21d36403-5cc0-4ca0-903f-edd8eb7193f5 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:40.790549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-21d36403-5cc0-4ca0-903f-edd8eb7193f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:40.883482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 838/1676] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:40 2022] POST /identity/v3/projects => generated 387 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:40.888326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769901d0-cdaf-47ca-b770-5310d97a051c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:40.894261 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-769901d0-cdaf-47ca-b770-5310d97a051c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:40.971115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 839/1677] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:40.982481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d972827-cf60-4d65-b1bf-3aa8bd1388a4 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:40.982968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d972827-cf60-4d65-b1bf-3aa8bd1388a4 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:40.983257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d972827-cf60-4d65-b1bf-3aa8bd1388a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:41.038698 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-7d972827-cf60-4d65-b1bf-3aa8bd1388a4 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:41.040584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7d972827-cf60-4d65-b1bf-3aa8bd1388a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:41.123786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769901d0-cdaf-47ca-b770-5310d97a051c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:41.149113 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42c4b6-6146-4fd1-963d-2eaf92f4a3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:41.150447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42c4b6-6146-4fd1-963d-2eaf92f4a3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:41.151437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42c4b6-6146-4fd1-963d-2eaf92f4a3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:41.151437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42c4b6-6146-4fd1-963d-2eaf92f4a3a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:41.152088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42c4b6-6146-4fd1-963d-2eaf92f4a3a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:41.155285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42c4b6-6146-4fd1-963d-2eaf92f4a3a3 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:41.210710 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 839/1678] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:40 2022] POST /identity/v3/users => generated 294 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:41.212914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 840/1679] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:41.215136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d972827-cf60-4d65-b1bf-3aa8bd1388a4 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:41.216774 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d9fbe-d0f8-4364-aaf4-8acf87addce5 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:41.218824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d9fbe-d0f8-4364-aaf4-8acf87addce5 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:41.219311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d9fbe-d0f8-4364-aaf4-8acf87addce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:41.260045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d972827-cf60-4d65-b1bf-3aa8bd1388a4 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:41.276080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb68a28-e639-40fe-a956-89a48cd7a010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:41.279755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb68a28-e639-40fe-a956-89a48cd7a010 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:41.282480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb68a28-e639-40fe-a956-89a48cd7a010 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:41.283840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb68a28-e639-40fe-a956-89a48cd7a010 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:41.284757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb68a28-e639-40fe-a956-89a48cd7a010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:41.295101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb68a28-e639-40fe-a956-89a48cd7a010 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:41.308914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a47d9fbe-d0f8-4364-aaf4-8acf87addce5 None None] MFA Rules not processed for user `cd0d8acbe24d410690470e3d9d4882b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:41.316082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a47d9fbe-d0f8-4364-aaf4-8acf87addce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:41.330588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 841/1680] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:41.332055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb68a28-e639-40fe-a956-89a48cd7a010 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:41.354935 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb68a28-e639-40fe-a956-89a48cd7a010 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:41.371620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ca4c0-966d-4aaf-a15c-285eac320f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:41.372360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ca4c0-966d-4aaf-a15c-285eac320f59 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:41.372646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ca4c0-966d-4aaf-a15c-285eac320f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:41.374366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ca4c0-966d-4aaf-a15c-285eac320f59 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:41.375315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ca4c0-966d-4aaf-a15c-285eac320f59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:41.375630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ca4c0-966d-4aaf-a15c-285eac320f59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:41.380046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ca4c0-966d-4aaf-a15c-285eac320f59 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:41.412812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 842/1681] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:41.414023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ca4c0-966d-4aaf-a15c-285eac320f59 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:41.429652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ca4c0-966d-4aaf-a15c-285eac320f59 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:41.436828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69faa36d-d1f9-4dff-bc7d-cacac49a9645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:41.439117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faa36d-d1f9-4dff-bc7d-cacac49a9645 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:41.439911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faa36d-d1f9-4dff-bc7d-cacac49a9645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:41.440472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faa36d-d1f9-4dff-bc7d-cacac49a9645 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:41.442247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69faa36d-d1f9-4dff-bc7d-cacac49a9645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:41.444704 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69faa36d-d1f9-4dff-bc7d-cacac49a9645 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:41.482559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 843/1682] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:41.485014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69faa36d-d1f9-4dff-bc7d-cacac49a9645 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:41.517947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69faa36d-d1f9-4dff-bc7d-cacac49a9645 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:41.540180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872cc1c-f21e-4748-9c16-e6ca1c672d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:41.555643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872cc1c-f21e-4748-9c16-e6ca1c672d7f admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:41.556539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872cc1c-f21e-4748-9c16-e6ca1c672d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:41.557525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872cc1c-f21e-4748-9c16-e6ca1c672d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:41.559661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872cc1c-f21e-4748-9c16-e6ca1c672d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:41.564420 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872cc1c-f21e-4748-9c16-e6ca1c672d7f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:41.676818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 840/1683] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:41.676818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d9fbe-d0f8-4364-aaf4-8acf87addce5 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:41.686140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 844/1684] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:41 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:41.689015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872cc1c-f21e-4748-9c16-e6ca1c672d7f admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:41.702366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1872cc1c-f21e-4748-9c16-e6ca1c672d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:41.734219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d9fbe-d0f8-4364-aaf4-8acf87addce5 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:42.026753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0ef13-6fd0-416d-a153-a428d16a4a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:42.027692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872cc1c-f21e-4748-9c16-e6ca1c672d7f admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:42.028186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0ef13-6fd0-416d-a153-a428d16a4a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:42.030367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0ef13-6fd0-416d-a153-a428d16a4a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:42.030815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0ef13-6fd0-416d-a153-a428d16a4a90 admin admin] PATH_INFO: `/v3/projects/937a6c8842db48f1b625d5dab2fbe8b5/users/586d00551faf4fe1be04082ded19d88e/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:42.046376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f458a4b-4c9f-4482-a31c-cd6f06b08b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:42.047064 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f458a4b-4c9f-4482-a31c-cd6f06b08b18 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:42.047349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f458a4b-4c9f-4482-a31c-cd6f06b08b18 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:42.047635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f458a4b-4c9f-4482-a31c-cd6f06b08b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:42.090556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0ef13-6fd0-416d-a153-a428d16a4a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937a6c8842db48f1b625d5dab2fbe8b5, user_id=586d00551faf4fe1be04082ded19d88e, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:42.108441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0ef13-6fd0-416d-a153-a428d16a4a90 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:42.160375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 841/1685] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:41 2022] PUT /identity/v3/projects/937a6c8842db48f1b625d5dab2fbe8b5/users/586d00551faf4fe1be04082ded19d88e/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:42.163574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0ef13-6fd0-416d-a153-a428d16a4a90 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:42.248212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f458a4b-4c9f-4482-a31c-cd6f06b08b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:42.252682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f458a4b-4c9f-4482-a31c-cd6f06b08b18 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:42.288303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 845/1686] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:42.292732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e383b6-a580-43cc-affe-75c28ead911e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:42.293052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e383b6-a580-43cc-affe-75c28ead911e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:42.293335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e383b6-a580-43cc-affe-75c28ead911e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:42.381839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-c0e383b6-a580-43cc-affe-75c28ead911e None None] MFA Rules not processed for user `586d00551faf4fe1be04082ded19d88e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:42.389506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c0e383b6-a580-43cc-affe-75c28ead911e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:42.399970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0ef13-6fd0-416d-a153-a428d16a4a90 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:42.410751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851ffc-371f-4c99-9439-4bb539cbe958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:42.411609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851ffc-371f-4c99-9439-4bb539cbe958 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:42.412047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851ffc-371f-4c99-9439-4bb539cbe958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:42.413139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851ffc-371f-4c99-9439-4bb539cbe958 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:42.414196 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3851ffc-371f-4c99-9439-4bb539cbe958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:42.418585 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3851ffc-371f-4c99-9439-4bb539cbe958 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:42.469492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 842/1687] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:42 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:42.473624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851ffc-371f-4c99-9439-4bb539cbe958 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:42.502242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851ffc-371f-4c99-9439-4bb539cbe958 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:42.512819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75dd0d-4bd4-4dc9-8edf-7337f20a8f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:42.513612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75dd0d-4bd4-4dc9-8edf-7337f20a8f35 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:42.516058 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75dd0d-4bd4-4dc9-8edf-7337f20a8f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:42.516460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75dd0d-4bd4-4dc9-8edf-7337f20a8f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:42.517897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75dd0d-4bd4-4dc9-8edf-7337f20a8f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:42.521273 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75dd0d-4bd4-4dc9-8edf-7337f20a8f35 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:42.556085 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 843/1688] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:48:42.557539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75dd0d-4bd4-4dc9-8edf-7337f20a8f35 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:42.583501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75dd0d-4bd4-4dc9-8edf-7337f20a8f35 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:42.602014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a98314-cd05-483a-ab7a-95fb8f9ff27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:42.602991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a98314-cd05-483a-ab7a-95fb8f9ff27d admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:42.603782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a98314-cd05-483a-ab7a-95fb8f9ff27d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:42.604185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a98314-cd05-483a-ab7a-95fb8f9ff27d admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:42.605060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a98314-cd05-483a-ab7a-95fb8f9ff27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:42.618223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a98314-cd05-483a-ab7a-95fb8f9ff27d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:42.621786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 846/1689] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:42.628009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e383b6-a580-43cc-affe-75c28ead911e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:42.633593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 844/1690] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:42.639560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a98314-cd05-483a-ab7a-95fb8f9ff27d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:42.644275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e383b6-a580-43cc-affe-75c28ead911e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:42.652166 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1bb53-aa00-4a59-8de0-57d93792dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:42.653140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1bb53-aa00-4a59-8de0-57d93792dd44 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:42.653576 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1bb53-aa00-4a59-8de0-57d93792dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:42.654005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1bb53-aa00-4a59-8de0-57d93792dd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:42.654928 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1bb53-aa00-4a59-8de0-57d93792dd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:42.657564 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1bb53-aa00-4a59-8de0-57d93792dd44 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:42.659700 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a98314-cd05-483a-ab7a-95fb8f9ff27d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:42.668004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e27b5-dd36-4a91-b863-0d66865842ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:42.669054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e27b5-dd36-4a91-b863-0d66865842ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:42.669438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e27b5-dd36-4a91-b863-0d66865842ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:42.669817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e27b5-dd36-4a91-b863-0d66865842ca admin admin] PATH_INFO: `/v3/projects/b230d284cdfe4ae79482bcfa7376edfb/users/e22dd1797db14656880c17d7e810a0a9/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:42.706230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e27b5-dd36-4a91-b863-0d66865842ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b230d284cdfe4ae79482bcfa7376edfb, user_id=e22dd1797db14656880c17d7e810a0a9, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:42.713067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e27b5-dd36-4a91-b863-0d66865842ca admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:42.747759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 845/1691] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:42 2022] PUT /identity/v3/projects/b230d284cdfe4ae79482bcfa7376edfb/users/e22dd1797db14656880c17d7e810a0a9/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:48:42.760098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084269a4-e08e-4879-8e75-e8c804067609 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:42.760494 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084269a4-e08e-4879-8e75-e8c804067609 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:42.760845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084269a4-e08e-4879-8e75-e8c804067609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:42.785632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 847/1692] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:42 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:42.788735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1bb53-aa00-4a59-8de0-57d93792dd44 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:42.824660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-084269a4-e08e-4879-8e75-e8c804067609 None None] MFA Rules not processed for user `e22dd1797db14656880c17d7e810a0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:42.828944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-084269a4-e08e-4879-8e75-e8c804067609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:42.965285 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1bb53-aa00-4a59-8de0-57d93792dd44 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:43.004113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ee99a-2b50-4019-abd1-89e3cf1ebf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:43.005738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee99a-2b50-4019-abd1-89e3cf1ebf02 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:43.007211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee99a-2b50-4019-abd1-89e3cf1ebf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:43.008385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee99a-2b50-4019-abd1-89e3cf1ebf02 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:43.010985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ee99a-2b50-4019-abd1-89e3cf1ebf02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:43.016211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ee99a-2b50-4019-abd1-89e3cf1ebf02 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:43.089820 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 846/1693] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:48:43.090719 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 848/1694] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:42 2022] POST /identity/v3/users => generated 299 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:43.091749 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ee99a-2b50-4019-abd1-89e3cf1ebf02 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:43.092555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084269a4-e08e-4879-8e75-e8c804067609 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:43.121076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ee99a-2b50-4019-abd1-89e3cf1ebf02 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:43.123145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084269a4-e08e-4879-8e75-e8c804067609 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:43.133597 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7dda3-882f-47c0-91ed-edf69e2e796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:43.137115 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588475e-2041-4d2d-9aaf-b6d42e674344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:43.138824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588475e-2041-4d2d-9aaf-b6d42e674344 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:43.140608 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7dda3-882f-47c0-91ed-edf69e2e796a admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:43.141179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588475e-2041-4d2d-9aaf-b6d42e674344 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:43.141689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7dda3-882f-47c0-91ed-edf69e2e796a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:43.142109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588475e-2041-4d2d-9aaf-b6d42e674344 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:43.142597 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7dda3-882f-47c0-91ed-edf69e2e796a admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:43.144276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7dda3-882f-47c0-91ed-edf69e2e796a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:43.146971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588475e-2041-4d2d-9aaf-b6d42e674344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:43.152932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7dda3-882f-47c0-91ed-edf69e2e796a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:43.153746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588475e-2041-4d2d-9aaf-b6d42e674344 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:43.183940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 847/1695] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:43.187069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588475e-2041-4d2d-9aaf-b6d42e674344 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:43.208435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588475e-2041-4d2d-9aaf-b6d42e674344 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:43.228043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199147-8eb4-4ee5-8534-e2bfc866bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:43.229833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 849/1696] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:43 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:43.234244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199147-8eb4-4ee5-8534-e2bfc866bee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:43.236130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199147-8eb4-4ee5-8534-e2bfc866bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:43.236763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7dda3-882f-47c0-91ed-edf69e2e796a admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:43.237260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199147-8eb4-4ee5-8534-e2bfc866bee9 admin admin] PATH_INFO: `/v3/projects/72621b952f094a138c7254d240f93f24/users/215cfce6c9f143138a96ff8c2c793700/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:43.276558 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14199147-8eb4-4ee5-8534-e2bfc866bee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72621b952f094a138c7254d240f93f24, user_id=215cfce6c9f143138a96ff8c2c793700, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:43.283205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14199147-8eb4-4ee5-8534-e2bfc866bee9 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:43.315242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 848/1697] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:43 2022] PUT /identity/v3/projects/72621b952f094a138c7254d240f93f24/users/215cfce6c9f143138a96ff8c2c793700/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:43.319327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199147-8eb4-4ee5-8534-e2bfc866bee9 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:43.439274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7dda3-882f-47c0-91ed-edf69e2e796a admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:43.640457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199147-8eb4-4ee5-8534-e2bfc866bee9 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:43.653542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8eb9a-b73e-434d-8ee2-6bfb22b680ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:43.654354 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8eb9a-b73e-434d-8ee2-6bfb22b680ba admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:43.654815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8eb9a-b73e-434d-8ee2-6bfb22b680ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:43.655224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8eb9a-b73e-434d-8ee2-6bfb22b680ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:43.657865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8eb9a-b73e-434d-8ee2-6bfb22b680ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:43.659816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8eb9a-b73e-434d-8ee2-6bfb22b680ba admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:43.675485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0a853-98e6-4ed3-a1de-ef2838234cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:43.682200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a853-98e6-4ed3-a1de-ef2838234cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:43.682494 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a853-98e6-4ed3-a1de-ef2838234cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:43.682778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0a853-98e6-4ed3-a1de-ef2838234cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:43.688415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0a853-98e6-4ed3-a1de-ef2838234cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:43.692036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 849/1698] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:43.700379 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0a853-98e6-4ed3-a1de-ef2838234cf9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:43.707958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8eb9a-b73e-434d-8ee2-6bfb22b680ba admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:43.738747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8eb9a-b73e-434d-8ee2-6bfb22b680ba admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:43.750646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dc24d-eac3-4cdf-bd3d-d44d9efdc6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:43.756903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc24d-eac3-4cdf-bd3d-d44d9efdc6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:43.757374 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc24d-eac3-4cdf-bd3d-d44d9efdc6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:43.757765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc24d-eac3-4cdf-bd3d-d44d9efdc6c8 admin admin] PATH_INFO: `/v3/projects/72621b952f094a138c7254d240f93f24/users/215cfce6c9f143138a96ff8c2c793700/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:43.760421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dc24d-eac3-4cdf-bd3d-d44d9efdc6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72621b952f094a138c7254d240f93f24, user_id=215cfce6c9f143138a96ff8c2c793700, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:43.764910 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dc24d-eac3-4cdf-bd3d-d44d9efdc6c8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:43.791295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 850/1699] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:43 2022] PUT /identity/v3/projects/72621b952f094a138c7254d240f93f24/users/215cfce6c9f143138a96ff8c2c793700/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:43.792185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dc24d-eac3-4cdf-bd3d-d44d9efdc6c8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:43.805436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 850/1700] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:43 2022] POST /identity/v3/users => generated 295 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:43.809109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd8451-af46-49d1-8485-020055894b40 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:43.809383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd8451-af46-49d1-8485-020055894b40 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:43.809666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd8451-af46-49d1-8485-020055894b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:43.893641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1cfd8451-af46-49d1-8485-020055894b40 None None] MFA Rules not processed for user `215cfce6c9f143138a96ff8c2c793700`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:43.896654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1cfd8451-af46-49d1-8485-020055894b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:44.051267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dc24d-eac3-4cdf-bd3d-d44d9efdc6c8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:44.081166 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 851/1701] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:44.083497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9ec81-6247-4b9c-8779-8c2cc980fda1 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:44.084446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac3da4-9ccc-4901-a5e9-227d5f893b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:44.084831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9ec81-6247-4b9c-8779-8c2cc980fda1 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:44.085232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9ec81-6247-4b9c-8779-8c2cc980fda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:44.097936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3da4-9ccc-4901-a5e9-227d5f893b14 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:44.101303 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3da4-9ccc-4901-a5e9-227d5f893b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:44.101551 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3da4-9ccc-4901-a5e9-227d5f893b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:44.102762 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac3da4-9ccc-4901-a5e9-227d5f893b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:44.104632 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac3da4-9ccc-4901-a5e9-227d5f893b14 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:44.129783 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b4d9ec81-6247-4b9c-8779-8c2cc980fda1 None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:44.135285 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b4d9ec81-6247-4b9c-8779-8c2cc980fda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:44.145505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 851/1702] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:44.153991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac3da4-9ccc-4901-a5e9-227d5f893b14 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:44.161406 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-55ac3da4-9ccc-4901-a5e9-227d5f893b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:44.270701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac3da4-9ccc-4901-a5e9-227d5f893b14 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:44.284615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6276e-1b57-45d1-85c6-fc83291f6a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:44.285526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6276e-1b57-45d1-85c6-fc83291f6a41 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:44.286036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6276e-1b57-45d1-85c6-fc83291f6a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:44.287096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6276e-1b57-45d1-85c6-fc83291f6a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:44.336005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6276e-1b57-45d1-85c6-fc83291f6a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:44.337637 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6276e-1b57-45d1-85c6-fc83291f6a41 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:44.374851 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 852/1703] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:48:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:44.376510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9ec81-6247-4b9c-8779-8c2cc980fda1 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:44.389618 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 852/1704] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:44.412348 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9ec81-6247-4b9c-8779-8c2cc980fda1 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:44.452737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6276e-1b57-45d1-85c6-fc83291f6a41 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:44.452888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1af1-9c41-493d-9c8a-465689481290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:44.453816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1af1-9c41-493d-9c8a-465689481290 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:44.454099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1af1-9c41-493d-9c8a-465689481290 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:44.454377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1af1-9c41-493d-9c8a-465689481290 admin admin] PATH_INFO: `/v3/projects/631fa4da7780448d87c102cfadebde26/users/247ba90d3b2c4009834a70d59fec01c9/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:44.478876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6276e-1b57-45d1-85c6-fc83291f6a41 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:44.517715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b1af1-9c41-493d-9c8a-465689481290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631fa4da7780448d87c102cfadebde26, user_id=247ba90d3b2c4009834a70d59fec01c9, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:44.520472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b1af1-9c41-493d-9c8a-465689481290 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:44.521261 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:44.525687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:44.526229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:44.530014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] PATH_INFO: `/v3/users/586d00551faf4fe1be04082ded19d88e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:44.533736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=586d00551faf4fe1be04082ded19d88e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:44.544191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:44.584796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 853/1705] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:44 2022] PUT /identity/v3/projects/631fa4da7780448d87c102cfadebde26/users/247ba90d3b2c4009834a70d59fec01c9/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:44.585817 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1af1-9c41-493d-9c8a-465689481290 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:44.596722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-cf8b1af1-9c41-493d-9c8a-465689481290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:44.746656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586d00551faf4fe1be04082ded19d88e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:44.779140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586d00551faf4fe1be04082ded19d88e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:44.785057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586d00551faf4fe1be04082ded19d88e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:44.803342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586d00551faf4fe1be04082ded19d88e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:44.829513 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586d00551faf4fe1be04082ded19d88e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:44.848089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 853/1706] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:48:44 2022] DELETE /identity/v3/users/586d00551faf4fe1be04082ded19d88e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:48:44.850566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:44.853329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:44.892004 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1af1-9c41-493d-9c8a-465689481290 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:44.997392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5e158-27eb-4de2-a772-1aff06bfee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:44.999831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5e158-27eb-4de2-a772-1aff06bfee9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:45.000779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5e158-27eb-4de2-a772-1aff06bfee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:45.001190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5e158-27eb-4de2-a772-1aff06bfee9a admin admin] PATH_INFO: `/v3/users/6661214f6806405d9cecb597d9349f4c` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:45.004031 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5e158-27eb-4de2-a772-1aff06bfee9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6661214f6806405d9cecb597d9349f4c)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:45.007390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5e158-27eb-4de2-a772-1aff06bfee9a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:45.057700 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ded1-548b-4d6f-a635-d0afa020d2fb admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:45.069125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac21a9-acc8-448b-afbf-c6b36aa69a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:45.070153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac21a9-acc8-448b-afbf-c6b36aa69a15 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:45.070591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac21a9-acc8-448b-afbf-c6b36aa69a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:45.071138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac21a9-acc8-448b-afbf-c6b36aa69a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:45.071962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac21a9-acc8-448b-afbf-c6b36aa69a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:45.073857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac21a9-acc8-448b-afbf-c6b36aa69a15 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:45.098771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 854/1707] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:45.098771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac21a9-acc8-448b-afbf-c6b36aa69a15 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:45.101534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-deac21a9-acc8-448b-afbf-c6b36aa69a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:45.123868 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-42f5e158-27eb-4de2-a772-1aff06bfee9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6661214f6806405d9cecb597d9349f4c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:45.189960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-42f5e158-27eb-4de2-a772-1aff06bfee9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6661214f6806405d9cecb597d9349f4c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:45.191845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-42f5e158-27eb-4de2-a772-1aff06bfee9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6661214f6806405d9cecb597d9349f4c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:45.192864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-42f5e158-27eb-4de2-a772-1aff06bfee9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6661214f6806405d9cecb597d9349f4c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:45.213867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-42f5e158-27eb-4de2-a772-1aff06bfee9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6661214f6806405d9cecb597d9349f4c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:45.246185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac21a9-acc8-448b-afbf-c6b36aa69a15 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:45.251727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 854/1708] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:48:44 2022] DELETE /identity/v3/users/6661214f6806405d9cecb597d9349f4c => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:45.254840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ed1bd-9486-460c-8cf9-5d6423122b52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:45.255641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ed1bd-9486-460c-8cf9-5d6423122b52 service swift] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:45.257032 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ed1bd-9486-460c-8cf9-5d6423122b52 service swift] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:45.257434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ed1bd-9486-460c-8cf9-5d6423122b52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:45.257719 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277c30-9c1e-45d0-a81c-a53b16a2ed54 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:45.258019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277c30-9c1e-45d0-a81c-a53b16a2ed54 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:45.258300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277c30-9c1e-45d0-a81c-a53b16a2ed54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:45.259824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-da3ed1bd-9486-460c-8cf9-5d6423122b52 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:45.322669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-db277c30-9c1e-45d0-a81c-a53b16a2ed54 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:45.324985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-db277c30-9c1e-45d0-a81c-a53b16a2ed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:45.341873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ed1bd-9486-460c-8cf9-5d6423122b52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:45.343888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ed1bd-9486-460c-8cf9-5d6423122b52 service swift] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:45.355942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 855/1709] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:48:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:48:45.358543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e309e3-6fe6-4e58-8269-ce4bd07a5df5 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:45.359072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e309e3-6fe6-4e58-8269-ce4bd07a5df5 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:45.359646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e309e3-6fe6-4e58-8269-ce4bd07a5df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:45.408565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-43e309e3-6fe6-4e58-8269-ce4bd07a5df5 None None] MFA Rules not processed for user `dab7aa55b2554d338cd76f34d03e1ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:45.409890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-43e309e3-6fe6-4e58-8269-ce4bd07a5df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:45.463310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 855/1710] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:45.464855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db277c30-9c1e-45d0-a81c-a53b16a2ed54 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:45.481467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-db277c30-9c1e-45d0-a81c-a53b16a2ed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:45.527946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db277c30-9c1e-45d0-a81c-a53b16a2ed54 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:45.540610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 856/1711] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:45.542231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d7f6-801c-4190-915c-58c03d2afc7a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:45.542658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d7f6-801c-4190-915c-58c03d2afc7a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:45.543132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d7f6-801c-4190-915c-58c03d2afc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:45.547561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7d3ac-33f2-4172-9b10-5a1a19e6a086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:45.548978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7d3ac-33f2-4172-9b10-5a1a19e6a086 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:45.555213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7d3ac-33f2-4172-9b10-5a1a19e6a086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:45.555910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7d3ac-33f2-4172-9b10-5a1a19e6a086 admin admin] PATH_INFO: `/v3/projects/631fa4da7780448d87c102cfadebde26/users/247ba90d3b2c4009834a70d59fec01c9/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:45.558684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7d3ac-33f2-4172-9b10-5a1a19e6a086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631fa4da7780448d87c102cfadebde26, user_id=247ba90d3b2c4009834a70d59fec01c9, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:45.562147 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7d3ac-33f2-4172-9b10-5a1a19e6a086 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:45.567212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-16b1d7f6-801c-4190-915c-58c03d2afc7a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:45.568851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-16b1d7f6-801c-4190-915c-58c03d2afc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:45.580575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 857/1712] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:45.582852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1d7f6-801c-4190-915c-58c03d2afc7a None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:45.586125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-16b1d7f6-801c-4190-915c-58c03d2afc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:45.607752 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 856/1713] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:45 2022] PUT /identity/v3/projects/631fa4da7780448d87c102cfadebde26/users/247ba90d3b2c4009834a70d59fec01c9/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:45.609052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7d3ac-33f2-4172-9b10-5a1a19e6a086 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:45.613598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-97c7d3ac-33f2-4172-9b10-5a1a19e6a086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:45.672029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1d7f6-801c-4190-915c-58c03d2afc7a None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:45.735543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7d3ac-33f2-4172-9b10-5a1a19e6a086 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:45.738406 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a9985-36d4-4370-b317-1eed8a78f0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:45.739914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a9985-36d4-4370-b317-1eed8a78f0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:45.741116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a9985-36d4-4370-b317-1eed8a78f0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:45.741556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a9985-36d4-4370-b317-1eed8a78f0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:45.744989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead3f4-0a31-4eb8-be67-871d7a51fcad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:45.745963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead3f4-0a31-4eb8-be67-871d7a51fcad service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:45.746417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead3f4-0a31-4eb8-be67-871d7a51fcad service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:45.746864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead3f4-0a31-4eb8-be67-871d7a51fcad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:45.889886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ead3f4-0a31-4eb8-be67-871d7a51fcad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:45.891757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ead3f4-0a31-4eb8-be67-871d7a51fcad service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:45.915782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a9985-36d4-4370-b317-1eed8a78f0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:45.917409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a9985-36d4-4370-b317-1eed8a78f0a0 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:45.964430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 857/1714] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:45.969929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead3f4-0a31-4eb8-be67-871d7a51fcad service nova] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:45.977254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 858/1715] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:45.984070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d7d9-d2ae-457d-9cb2-edcf88a6fe2a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:45.984502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d7d9-d2ae-457d-9cb2-edcf88a6fe2a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:45.985276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d7d9-d2ae-457d-9cb2-edcf88a6fe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:46.026074 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead3f4-0a31-4eb8-be67-871d7a51fcad service nova] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:46.056326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7f583-70ac-496e-a91f-fa9ca490a2bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:46.057047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7f583-70ac-496e-a91f-fa9ca490a2bf service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:46.057343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7f583-70ac-496e-a91f-fa9ca490a2bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:46.057620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7f583-70ac-496e-a91f-fa9ca490a2bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:46.094087 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-1a78d7d9-d2ae-457d-9cb2-edcf88a6fe2a None None] MFA Rules not processed for user `247ba90d3b2c4009834a70d59fec01c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:46.104755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7f583-70ac-496e-a91f-fa9ca490a2bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:46.107743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1a78d7d9-d2ae-457d-9cb2-edcf88a6fe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:46.108257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7f583-70ac-496e-a91f-fa9ca490a2bf service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:46.166203 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 858/1716] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:46.448157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 859/1717] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:46.460019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7f583-70ac-496e-a91f-fa9ca490a2bf service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:46.462170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4eb7f583-70ac-496e-a91f-fa9ca490a2bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:46.601186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7f583-70ac-496e-a91f-fa9ca490a2bf service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:46.606879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f009b4d-1b74-4ab9-9b0f-3d7d0eb1a537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:46.607822 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f009b4d-1b74-4ab9-9b0f-3d7d0eb1a537 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:46.608110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f009b4d-1b74-4ab9-9b0f-3d7d0eb1a537 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:46.608382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f009b4d-1b74-4ab9-9b0f-3d7d0eb1a537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:46.610285 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0f009b4d-1b74-4ab9-9b0f-3d7d0eb1a537 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:46.729191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f009b4d-1b74-4ab9-9b0f-3d7d0eb1a537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:46.730912 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f009b4d-1b74-4ab9-9b0f-3d7d0eb1a537 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:46.745359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 859/1718] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:48:47.142273 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36369e5-a82c-473f-be17-803c89b169ec None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:47.142764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36369e5-a82c-473f-be17-803c89b169ec None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:47.143470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36369e5-a82c-473f-be17-803c89b169ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:47.348170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c36369e5-a82c-473f-be17-803c89b169ec None None] MFA Rules not processed for user `8928566ff693460f8243c43078a6a575`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:47.362666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c36369e5-a82c-473f-be17-803c89b169ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:47.830888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 860/1719] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 695 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:47.846619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f009b4d-1b74-4ab9-9b0f-3d7d0eb1a537 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:47.892866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f009b4d-1b74-4ab9-9b0f-3d7d0eb1a537 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:47.968227 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6f5c8-b5f3-4064-9026-fe8f0833f482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:47.972397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6f5c8-b5f3-4064-9026-fe8f0833f482 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:47.972733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6f5c8-b5f3-4064-9026-fe8f0833f482 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:47.974525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6f5c8-b5f3-4064-9026-fe8f0833f482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:48.036198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6f5c8-b5f3-4064-9026-fe8f0833f482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:48.039106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6f5c8-b5f3-4064-9026-fe8f0833f482 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:48.082308 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 860/1720] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:48.169272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36369e5-a82c-473f-be17-803c89b169ec None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:48.172336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c36369e5-a82c-473f-be17-803c89b169ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:48.215963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36369e5-a82c-473f-be17-803c89b169ec None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:48.242323 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:48.243410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:48.243870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:48.244269 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] PATH_INFO: `/v3/projects/332a575667ce44b6a4549a1c81ff4718` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:48.250412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=332a575667ce44b6a4549a1c81ff4718)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:48.252957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:48.310651 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049372e-dcfc-4ade-bdc6-05079d01f0c7 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:48.311440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049372e-dcfc-4ade-bdc6-05079d01f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:48.311915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049372e-dcfc-4ade-bdc6-05079d01f0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:48.358142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-9049372e-dcfc-4ade-bdc6-05079d01f0c7 None None] MFA Rules not processed for user `c22a0fc8a3914f7fb3356a84827db326`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:48.362725 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9049372e-dcfc-4ade-bdc6-05079d01f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:48.391908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 861/1721] 10.222.0.61 () {58 vars in 1015 bytes} [Mon May 16 18:48:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:48:48.442763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049372e-dcfc-4ade-bdc6-05079d01f0c7 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:48.445501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9049372e-dcfc-4ade-bdc6-05079d01f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:48.470178 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332a575667ce44b6a4549a1c81ff4718', 'request_id': 'req-5aa261b0-a698-48d7-9e12-30cca4543349'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:48.479342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049372e-dcfc-4ade-bdc6-05079d01f0c7 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:48.511650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332a575667ce44b6a4549a1c81ff4718', 'request_id': 'req-5aa261b0-a698-48d7-9e12-30cca4543349'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:48.528890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332a575667ce44b6a4549a1c81ff4718', 'request_id': 'req-5aa261b0-a698-48d7-9e12-30cca4543349'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:48.561542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] The token cache is being invalidate because project 332a575667ce44b6a4549a1c81ff4718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:48:48.561862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:48.564317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5aa261b0-a698-48d7-9e12-30cca4543349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:48.569067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 861/1722] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:48:48 2022] DELETE /identity/v3/projects/332a575667ce44b6a4549a1c81ff4718 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:48.574861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a9642-5bce-4a0d-afed-e48b1d5e7ee1 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:48.575147 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a9642-5bce-4a0d-afed-e48b1d5e7ee1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:48.575431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a9642-5bce-4a0d-afed-e48b1d5e7ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:48.632555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-304a9642-5bce-4a0d-afed-e48b1d5e7ee1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:48.636914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-304a9642-5bce-4a0d-afed-e48b1d5e7ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:48.648048 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff8871-5c97-4291-8648-6b9b44020f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:48.649026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff8871-5c97-4291-8648-6b9b44020f46 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:48.651737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff8871-5c97-4291-8648-6b9b44020f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:48.651737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff8871-5c97-4291-8648-6b9b44020f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:48.660289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-96ff8871-5c97-4291-8648-6b9b44020f46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:48.692340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff8871-5c97-4291-8648-6b9b44020f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:48.698063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff8871-5c97-4291-8648-6b9b44020f46 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:48.722309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 862/1723] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:48.747967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff8871-5c97-4291-8648-6b9b44020f46 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:48.749654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-96ff8871-5c97-4291-8648-6b9b44020f46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:48.838903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 862/1724] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:48:48.841537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f390-d018-43c7-accd-9e7e359c9b3d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:48.842084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f390-d018-43c7-accd-9e7e359c9b3d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:48.842084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f390-d018-43c7-accd-9e7e359c9b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:48.898638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-bfa2f390-d018-43c7-accd-9e7e359c9b3d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:48.902770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-bfa2f390-d018-43c7-accd-9e7e359c9b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:48.983389 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 863/1725] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:48.984436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2f390-d018-43c7-accd-9e7e359c9b3d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:48.987572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff8871-5c97-4291-8648-6b9b44020f46 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:49.017849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:49.019945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:49.020444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:49.021029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] PATH_INFO: `/v3/projects/937a6c8842db48f1b625d5dab2fbe8b5` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:49.024893 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937a6c8842db48f1b625d5dab2fbe8b5)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:49.035532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2f390-d018-43c7-accd-9e7e359c9b3d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:49.035833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:49.072232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ce9a2-231a-4671-a093-22bc30a84586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:49.073015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ce9a2-231a-4671-a093-22bc30a84586 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:49.073307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ce9a2-231a-4671-a093-22bc30a84586 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:49.073583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ce9a2-231a-4671-a093-22bc30a84586 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:49.076137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ce9a2-231a-4671-a093-22bc30a84586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:49.077171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ce9a2-231a-4671-a093-22bc30a84586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:49.084626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ce9a2-231a-4671-a093-22bc30a84586 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:49.145419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 864/1726] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:49.148867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ce9a2-231a-4671-a093-22bc30a84586 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:49.176315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ce9a2-231a-4671-a093-22bc30a84586 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:49.207143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937a6c8842db48f1b625d5dab2fbe8b5', 'request_id': 'req-25c6c8cd-d1c0-4e76-8243-ace32cad9296'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:49.229787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937a6c8842db48f1b625d5dab2fbe8b5', 'request_id': 'req-25c6c8cd-d1c0-4e76-8243-ace32cad9296'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:49.261343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937a6c8842db48f1b625d5dab2fbe8b5', 'request_id': 'req-25c6c8cd-d1c0-4e76-8243-ace32cad9296'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:49.290415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] The token cache is being invalidate because project 937a6c8842db48f1b625d5dab2fbe8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:48:49.293010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:49.298726 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:49.306493 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 863/1727] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:48:48 2022] DELETE /identity/v3/projects/937a6c8842db48f1b625d5dab2fbe8b5 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:48:49.309156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:49.317574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:49.341742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29e9da-2166-4835-bb5d-183d5bc6f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:49.342450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29e9da-2166-4835-bb5d-183d5bc6f482 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:49.342728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29e9da-2166-4835-bb5d-183d5bc6f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:49.343865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29e9da-2166-4835-bb5d-183d5bc6f482 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:49.344764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29e9da-2166-4835-bb5d-183d5bc6f482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:49.353827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29e9da-2166-4835-bb5d-183d5bc6f482 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:49.383667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c8cd-d1c0-4e76-8243-ace32cad9296 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:49.405865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:49.408677 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:49.412649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:49.420229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] PATH_INFO: `/v3/users/215cfce6c9f143138a96ff8c2c793700` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:49.423212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 865/1728] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:49 2022] POST /identity/v3/projects => generated 371 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:49.424200 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29e9da-2166-4835-bb5d-183d5bc6f482 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:49.424538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=215cfce6c9f143138a96ff8c2c793700)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:49.426151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5f29e9da-2166-4835-bb5d-183d5bc6f482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:49.429975 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:49.588556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215cfce6c9f143138a96ff8c2c793700'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:49.639277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215cfce6c9f143138a96ff8c2c793700'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:49.640873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215cfce6c9f143138a96ff8c2c793700'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:49.645678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215cfce6c9f143138a96ff8c2c793700'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:49.667646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215cfce6c9f143138a96ff8c2c793700'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:49.699963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 864/1729] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:48:49 2022] DELETE /identity/v3/users/215cfce6c9f143138a96ff8c2c793700 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:49.713929 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29e9da-2166-4835-bb5d-183d5bc6f482 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:49.914888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0453f-fc32-4266-bf18-4f205df9de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:49.917100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0453f-fc32-4266-bf18-4f205df9de30 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:49.917538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0453f-fc32-4266-bf18-4f205df9de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:49.918874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0453f-fc32-4266-bf18-4f205df9de30 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:49.921738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0453f-fc32-4266-bf18-4f205df9de30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:49.925456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0453f-fc32-4266-bf18-4f205df9de30 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:50.007329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 866/1730] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:49 2022] POST /identity/v3/users => generated 286 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:50.012857 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:50.015163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:50.043671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88144-3bab-4c23-adf8-41fd498a6d17 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:50.057436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fedb8d-dc60-4980-825c-6a6b2fd308c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:50.058146 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fedb8d-dc60-4980-825c-6a6b2fd308c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:50.058433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fedb8d-dc60-4980-825c-6a6b2fd308c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:50.058712 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fedb8d-dc60-4980-825c-6a6b2fd308c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:50.059462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fedb8d-dc60-4980-825c-6a6b2fd308c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:50.061576 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fedb8d-dc60-4980-825c-6a6b2fd308c8 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:50.118707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 865/1731] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:50.122396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0453f-fc32-4266-bf18-4f205df9de30 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:50.142174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0453f-fc32-4266-bf18-4f205df9de30 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:50.174450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b980a5-da33-43e5-9891-75ff6b99294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:50.175332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b980a5-da33-43e5-9891-75ff6b99294d admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:50.175738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b980a5-da33-43e5-9891-75ff6b99294d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:50.176276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b980a5-da33-43e5-9891-75ff6b99294d admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:50.177222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b980a5-da33-43e5-9891-75ff6b99294d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:50.180236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b980a5-da33-43e5-9891-75ff6b99294d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:50.223968 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 867/1732] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:50.227325 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fedb8d-dc60-4980-825c-6a6b2fd308c8 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:50.249792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fedb8d-dc60-4980-825c-6a6b2fd308c8 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:50.274931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec292f4-a81f-4580-b167-5a1cf5cb87ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:50.276098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec292f4-a81f-4580-b167-5a1cf5cb87ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:50.276494 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec292f4-a81f-4580-b167-5a1cf5cb87ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:50.276884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec292f4-a81f-4580-b167-5a1cf5cb87ea admin admin] PATH_INFO: `/v3/projects/3da38b286e004405b81744905dcf74a2/users/fe7a2576960f4dfdba2ed7f9ef48f325/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:50.343899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec292f4-a81f-4580-b167-5a1cf5cb87ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da38b286e004405b81744905dcf74a2, user_id=fe7a2576960f4dfdba2ed7f9ef48f325, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:50.354193 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec292f4-a81f-4580-b167-5a1cf5cb87ea admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:50.396120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 866/1733] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:50 2022] PUT /identity/v3/projects/3da38b286e004405b81744905dcf74a2/users/fe7a2576960f4dfdba2ed7f9ef48f325/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:50.417451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dd22a-dd02-4495-9f32-e2d86e329284 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:50.417804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dd22a-dd02-4495-9f32-e2d86e329284 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:50.418292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dd22a-dd02-4495-9f32-e2d86e329284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:50.500811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-4a7dd22a-dd02-4495-9f32-e2d86e329284 None None] MFA Rules not processed for user `fe7a2576960f4dfdba2ed7f9ef48f325`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:50.508510 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4a7dd22a-dd02-4495-9f32-e2d86e329284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:50.748126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 868/1734] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:50.755956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec292f4-a81f-4580-b167-5a1cf5cb87ea admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:50.758410 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-6ec292f4-a81f-4580-b167-5a1cf5cb87ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:51.066978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec292f4-a81f-4580-b167-5a1cf5cb87ea admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:51.078816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953d15d-031a-4bb9-b6f7-723b61b18e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:51.079863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953d15d-031a-4bb9-b6f7-723b61b18e36 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:51.080391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953d15d-031a-4bb9-b6f7-723b61b18e36 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:51.080892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953d15d-031a-4bb9-b6f7-723b61b18e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:51.101305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953d15d-031a-4bb9-b6f7-723b61b18e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:51.108350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953d15d-031a-4bb9-b6f7-723b61b18e36 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:51.150336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 867/1735] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:52.551107 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dd22a-dd02-4495-9f32-e2d86e329284 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:52.553946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4a7dd22a-dd02-4495-9f32-e2d86e329284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:53.029909 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dd22a-dd02-4495-9f32-e2d86e329284 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:53.071905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:53.075472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:53.078625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:53.080128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] PATH_INFO: `/v3/projects/72621b952f094a138c7254d240f93f24` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:53.090387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] RBAC: Authorizing `identity:delete_project(project_id=72621b952f094a138c7254d240f93f24)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:53.094752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:53.293297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72621b952f094a138c7254d240f93f24', 'request_id': 'req-f4caa0a1-20a5-45ce-a365-47f4b913272c'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:53.351657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72621b952f094a138c7254d240f93f24', 'request_id': 'req-f4caa0a1-20a5-45ce-a365-47f4b913272c'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:53.411464 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72621b952f094a138c7254d240f93f24', 'request_id': 'req-f4caa0a1-20a5-45ce-a365-47f4b913272c'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:53.488562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] The token cache is being invalidate because project 72621b952f094a138c7254d240f93f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:48:53.489016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:53.492328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f4caa0a1-20a5-45ce-a365-47f4b913272c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:53.504755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 869/1736] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:48:52 2022] DELETE /identity/v3/projects/72621b952f094a138c7254d240f93f24 => generated 0 bytes in 950 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:53.507125 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a9ef-6089-4587-a2e4-3b759fba641e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:53.508643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a9ef-6089-4587-a2e4-3b759fba641e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:53.509379 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867a9ef-6089-4587-a2e4-3b759fba641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:53.566671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0867a9ef-6089-4587-a2e4-3b759fba641e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:53.568704 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0867a9ef-6089-4587-a2e4-3b759fba641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:53.759429 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 868/1737] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:53.770695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fe735-a6b8-49e9-bc08-9bd970266b35 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:53.771905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fe735-a6b8-49e9-bc08-9bd970266b35 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:53.772260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fe735-a6b8-49e9-bc08-9bd970266b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:53.879582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-0f2fe735-a6b8-49e9-bc08-9bd970266b35 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:53.891970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0f2fe735-a6b8-49e9-bc08-9bd970266b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:53.932387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 870/1738] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:53.938922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a9ef-6089-4587-a2e4-3b759fba641e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:53.960295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867a9ef-6089-4587-a2e4-3b759fba641e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:53.972094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816748a6-5f99-481d-bc17-2800c6375df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:53.976102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816748a6-5f99-481d-bc17-2800c6375df9 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:53.977208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816748a6-5f99-481d-bc17-2800c6375df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:53.978988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816748a6-5f99-481d-bc17-2800c6375df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:53.981749 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816748a6-5f99-481d-bc17-2800c6375df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:53.983114 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816748a6-5f99-481d-bc17-2800c6375df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:53.987440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816748a6-5f99-481d-bc17-2800c6375df9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:54.043646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 869/1739] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:54.045853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fe735-a6b8-49e9-bc08-9bd970266b35 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:54.077367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fe735-a6b8-49e9-bc08-9bd970266b35 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:54.119006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca61b4c-6f02-4903-8dec-f5888944fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:54.120409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca61b4c-6f02-4903-8dec-f5888944fe35 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:54.121149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca61b4c-6f02-4903-8dec-f5888944fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:54.121874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca61b4c-6f02-4903-8dec-f5888944fe35 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:54.123900 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca61b4c-6f02-4903-8dec-f5888944fe35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:54.133411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca61b4c-6f02-4903-8dec-f5888944fe35 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:54.207373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816748a6-5f99-481d-bc17-2800c6375df9 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:54.222353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-816748a6-5f99-481d-bc17-2800c6375df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:54.259484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 871/1740] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:54 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:54.263088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca61b4c-6f02-4903-8dec-f5888944fe35 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:54.545341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca61b4c-6f02-4903-8dec-f5888944fe35 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:54.582120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816748a6-5f99-481d-bc17-2800c6375df9 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:54.582832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6408f-f127-4ec7-a065-2106400ba066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:54.585128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6408f-f127-4ec7-a065-2106400ba066 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:54.589935 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6408f-f127-4ec7-a065-2106400ba066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:54.590312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6408f-f127-4ec7-a065-2106400ba066 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:54.591264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6408f-f127-4ec7-a065-2106400ba066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:54.600827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6408f-f127-4ec7-a065-2106400ba066 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:54.647890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 872/1741] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:54 2022] POST /identity/v3/users => generated 289 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:54.652649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6408f-f127-4ec7-a065-2106400ba066 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:54.683290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6408f-f127-4ec7-a065-2106400ba066 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:54.695866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9b1ec-7f82-462f-a616-2e3df1b3c430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:54.700482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9b1ec-7f82-462f-a616-2e3df1b3c430 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:54.700803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9b1ec-7f82-462f-a616-2e3df1b3c430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:54.703086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9b1ec-7f82-462f-a616-2e3df1b3c430 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:54.706094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9b1ec-7f82-462f-a616-2e3df1b3c430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:54.717873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9b1ec-7f82-462f-a616-2e3df1b3c430 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:54.813471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 873/1742] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:48:54.814686 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9b1ec-7f82-462f-a616-2e3df1b3c430 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:54.853294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9b1ec-7f82-462f-a616-2e3df1b3c430 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:54.871951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679671c-79d8-4ebb-98d5-61a27f1b9284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:54.872670 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679671c-79d8-4ebb-98d5-61a27f1b9284 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:54.872956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679671c-79d8-4ebb-98d5-61a27f1b9284 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:54.873234 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679671c-79d8-4ebb-98d5-61a27f1b9284 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:54.873991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679671c-79d8-4ebb-98d5-61a27f1b9284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:54.878852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28866e-b863-432e-ab96-375c3014a731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:54.884999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28866e-b863-432e-ab96-375c3014a731 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:54.885530 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28866e-b863-432e-ab96-375c3014a731 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:54.887210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679671c-79d8-4ebb-98d5-61a27f1b9284 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:54.888546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28866e-b863-432e-ab96-375c3014a731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:54.900027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ed28866e-b863-432e-ab96-375c3014a731 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:54.945341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 874/1743] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:54.946801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679671c-79d8-4ebb-98d5-61a27f1b9284 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:54.984565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679671c-79d8-4ebb-98d5-61a27f1b9284 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:55.004671 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a3468-5fed-4e37-8284-0c9e7defc95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:55.006411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a3468-5fed-4e37-8284-0c9e7defc95d admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:55.009955 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a3468-5fed-4e37-8284-0c9e7defc95d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:55.010511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a3468-5fed-4e37-8284-0c9e7defc95d admin admin] PATH_INFO: `/v3/projects/95d2e824ebea43fba3453a7ee3215b04/users/06fc7534cf304568beda7130d62e9262/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:55.125941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a3468-5fed-4e37-8284-0c9e7defc95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d2e824ebea43fba3453a7ee3215b04, user_id=06fc7534cf304568beda7130d62e9262, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:55.135405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a3468-5fed-4e37-8284-0c9e7defc95d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:55.136292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28866e-b863-432e-ab96-375c3014a731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:55.140629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28866e-b863-432e-ab96-375c3014a731 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:55.171236 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 870/1744] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 966 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:55.175753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ec492-8b7c-4864-a2d1-802823cefacb None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:55.176027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ec492-8b7c-4864-a2d1-802823cefacb None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:55.176420 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ec492-8b7c-4864-a2d1-802823cefacb None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:55.188659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 871/1745] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:48:55 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:48:55.224639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 875/1746] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:54 2022] PUT /identity/v3/projects/95d2e824ebea43fba3453a7ee3215b04/users/06fc7534cf304568beda7130d62e9262/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:55.226503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240959f4-586f-4259-9ad6-7f26183cf653 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:55.226972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240959f4-586f-4259-9ad6-7f26183cf653 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:55.227468 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240959f4-586f-4259-9ad6-7f26183cf653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:55.239323 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45554-5a86-4d0b-b78e-e330d0a4e24b None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:55.245592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45554-5a86-4d0b-b78e-e330d0a4e24b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:55.246125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45554-5a86-4d0b-b78e-e330d0a4e24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:55.350372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-90e45554-5a86-4d0b-b78e-e330d0a4e24b None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:55.351924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-90e45554-5a86-4d0b-b78e-e330d0a4e24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:55.353821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-240959f4-586f-4259-9ad6-7f26183cf653 None None] MFA Rules not processed for user `06fc7534cf304568beda7130d62e9262`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:55.365706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-240959f4-586f-4259-9ad6-7f26183cf653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:55.678781 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 872/1747] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:55.681734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921408-3d56-4909-a541-c13c963985c5 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:55.682005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921408-3d56-4909-a541-c13c963985c5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:55.682803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921408-3d56-4909-a541-c13c963985c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:55.693166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 876/1748] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:48:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:48:55.694173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e45554-5a86-4d0b-b78e-e330d0a4e24b None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:55.698663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-90e45554-5a86-4d0b-b78e-e330d0a4e24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:55.745212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-02921408-3d56-4909-a541-c13c963985c5 None None] MFA Rules not processed for user `8928566ff693460f8243c43078a6a575`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:55.746684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-02921408-3d56-4909-a541-c13c963985c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:56.073556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 873/1749] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:56.075413 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02921408-3d56-4909-a541-c13c963985c5 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:56.095151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e45554-5a86-4d0b-b78e-e330d0a4e24b None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:56.120287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:56.124942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:56.126971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02921408-3d56-4909-a541-c13c963985c5 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:56.127870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:56.128581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] PATH_INFO: `/v3/users/fe7a2576960f4dfdba2ed7f9ef48f325` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:56.136048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7a2576960f4dfdba2ed7f9ef48f325)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:56.140937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:56.162268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a536b4-d228-4d93-a80b-83e61a7f9eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:56.163949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a536b4-d228-4d93-a80b-83e61a7f9eff admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:56.166405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a536b4-d228-4d93-a80b-83e61a7f9eff admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:56.167563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a536b4-d228-4d93-a80b-83e61a7f9eff admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:56.171239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a536b4-d228-4d93-a80b-83e61a7f9eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:56.185589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a536b4-d228-4d93-a80b-83e61a7f9eff admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:56.308515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 874/1750] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:56 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:56.308515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a536b4-d228-4d93-a80b-83e61a7f9eff admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:56.322591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c3a536b4-d228-4d93-a80b-83e61a7f9eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:56.402927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7a2576960f4dfdba2ed7f9ef48f325'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:56.463086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7a2576960f4dfdba2ed7f9ef48f325'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:56.465506 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7a2576960f4dfdba2ed7f9ef48f325'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:56.492536 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7a2576960f4dfdba2ed7f9ef48f325'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:56.509135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7a2576960f4dfdba2ed7f9ef48f325'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:56.523245 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 877/1751] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:48:55 2022] DELETE /identity/v3/users/fe7a2576960f4dfdba2ed7f9ef48f325 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:56.527861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:56.529899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:56.629275 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a536b4-d228-4d93-a80b-83e61a7f9eff admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:56.648545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74433b-2220-46f3-8bf3-864fe341f358 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:56.664107 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d955d-5f51-4a1d-9bed-03592115b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:56.664957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d955d-5f51-4a1d-9bed-03592115b23e admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:56.665373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d955d-5f51-4a1d-9bed-03592115b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:56.665852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d955d-5f51-4a1d-9bed-03592115b23e admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:56.666931 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d955d-5f51-4a1d-9bed-03592115b23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:56.675354 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d955d-5f51-4a1d-9bed-03592115b23e admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:56.752326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 878/1752] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:56 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:56.755569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2f89-f78a-4728-986a-df13cef75bf4 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:56.756399 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2f89-f78a-4728-986a-df13cef75bf4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:56.757616 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2f89-f78a-4728-986a-df13cef75bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:56.792373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-489a2f89-f78a-4728-986a-df13cef75bf4 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:56.796121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-489a2f89-f78a-4728-986a-df13cef75bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:56.812002 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 879/1753] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:56.813072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2f89-f78a-4728-986a-df13cef75bf4 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:56.830363 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2f89-f78a-4728-986a-df13cef75bf4 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:56.835740 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22e0bc-4389-467b-beab-a50a28faf426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:56.836663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22e0bc-4389-467b-beab-a50a28faf426 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:56.836946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22e0bc-4389-467b-beab-a50a28faf426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:56.837220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22e0bc-4389-467b-beab-a50a28faf426 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:56.838141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22e0bc-4389-467b-beab-a50a28faf426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:56.840697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22e0bc-4389-467b-beab-a50a28faf426 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:56.880058 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 880/1754] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:56.883438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b797e-82da-4ceb-842c-7cf39685a87b None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:56.883758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b797e-82da-4ceb-842c-7cf39685a87b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:56.885581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b797e-82da-4ceb-842c-7cf39685a87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:56.895086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dc17b-d4ab-43de-b6c0-f92fbbc644cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:56.896757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dc17b-d4ab-43de-b6c0-f92fbbc644cb service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:56.897378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dc17b-d4ab-43de-b6c0-f92fbbc644cb service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:56.897988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dc17b-d4ab-43de-b6c0-f92fbbc644cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:56.902107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-126dc17b-d4ab-43de-b6c0-f92fbbc644cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:56.954239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dc17b-d4ab-43de-b6c0-f92fbbc644cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:56.957260 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dc17b-d4ab-43de-b6c0-f92fbbc644cb service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:56.969292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-bc0b797e-82da-4ceb-842c-7cf39685a87b None None] MFA Rules not processed for user `cd0d8acbe24d410690470e3d9d4882b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:56.973340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-bc0b797e-82da-4ceb-842c-7cf39685a87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:56.997927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 875/1755] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:57.008892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dc17b-d4ab-43de-b6c0-f92fbbc644cb service nova] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:57.015405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-126dc17b-d4ab-43de-b6c0-f92fbbc644cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:57.203313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 881/1756] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:57.204318 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b797e-82da-4ceb-842c-7cf39685a87b None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:57.225110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dc17b-d4ab-43de-b6c0-f92fbbc644cb service nova] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:57.231855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b797e-82da-4ceb-842c-7cf39685a87b None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:57.235216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2f6a3-3a45-41ff-8e2a-bbbf1fec0fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:57.236081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2f6a3-3a45-41ff-8e2a-bbbf1fec0fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:57.237045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2f6a3-3a45-41ff-8e2a-bbbf1fec0fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:57.237893 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2f6a3-3a45-41ff-8e2a-bbbf1fec0fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:57.245667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592c9a5-6345-4934-8de7-3a7da7d2b03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:57.246858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592c9a5-6345-4934-8de7-3a7da7d2b03d admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:57.247223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592c9a5-6345-4934-8de7-3a7da7d2b03d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:57.247576 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592c9a5-6345-4934-8de7-3a7da7d2b03d admin admin] PATH_INFO: `/v3/projects/46bfc4d6e1274482a27bbdc5144a7e4e/users/8522ae9773b84cb6a9bd381de20c9e30/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:57.273811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592c9a5-6345-4934-8de7-3a7da7d2b03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bfc4d6e1274482a27bbdc5144a7e4e, user_id=8522ae9773b84cb6a9bd381de20c9e30, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:57.274013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2f6a3-3a45-41ff-8e2a-bbbf1fec0fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:57.275487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2f6a3-3a45-41ff-8e2a-bbbf1fec0fa9 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:57.278018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592c9a5-6345-4934-8de7-3a7da7d2b03d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:57.298119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 876/1757] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:57.322231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 882/1758] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:57 2022] PUT /identity/v3/projects/46bfc4d6e1274482a27bbdc5144a7e4e/users/8522ae9773b84cb6a9bd381de20c9e30/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:57.323109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2f6a3-3a45-41ff-8e2a-bbbf1fec0fa9 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:57.346428 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2f6a3-3a45-41ff-8e2a-bbbf1fec0fa9 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:57.462579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5330c5-dffb-4ec2-8ad5-34faec8b62ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:57.463627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5330c5-dffb-4ec2-8ad5-34faec8b62ba admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:57.463850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5330c5-dffb-4ec2-8ad5-34faec8b62ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:57.464368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5330c5-dffb-4ec2-8ad5-34faec8b62ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:57.465131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5330c5-dffb-4ec2-8ad5-34faec8b62ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:57.467309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5330c5-dffb-4ec2-8ad5-34faec8b62ba admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:57.486140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 877/1759] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:57.491148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592c9a5-6345-4934-8de7-3a7da7d2b03d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:57.506975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592c9a5-6345-4934-8de7-3a7da7d2b03d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:57.512367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f547f3-eeeb-460c-9acd-84257d33dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:57.518236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f547f3-eeeb-460c-9acd-84257d33dc50 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:57.518573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f547f3-eeeb-460c-9acd-84257d33dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:57.519542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f547f3-eeeb-460c-9acd-84257d33dc50 admin admin] PATH_INFO: `/v3/projects/46bfc4d6e1274482a27bbdc5144a7e4e/users/8522ae9773b84cb6a9bd381de20c9e30/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:57.521968 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f547f3-eeeb-460c-9acd-84257d33dc50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bfc4d6e1274482a27bbdc5144a7e4e, user_id=8522ae9773b84cb6a9bd381de20c9e30, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:57.524852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f547f3-eeeb-460c-9acd-84257d33dc50 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:57.574566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 883/1760] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:57 2022] PUT /identity/v3/projects/46bfc4d6e1274482a27bbdc5144a7e4e/users/8522ae9773b84cb6a9bd381de20c9e30/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:57.575957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613b1c-9c00-44ce-977b-aa072a38cb98 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:57.577505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613b1c-9c00-44ce-977b-aa072a38cb98 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:57.577946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613b1c-9c00-44ce-977b-aa072a38cb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:57.593119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f87b0-2aa8-4c37-8d0e-a1417674cfd7 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:57.593119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f87b0-2aa8-4c37-8d0e-a1417674cfd7 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:57.593119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f87b0-2aa8-4c37-8d0e-a1417674cfd7 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:57.594744 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 884/1761] 10.222.0.72 () {54 vars in 912 bytes} [Mon May 16 18:48:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:48:57.621953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01eb3f-d1ce-4416-9700-229b4c1c3797 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:57.624774 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01eb3f-d1ce-4416-9700-229b4c1c3797 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:57.625069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01eb3f-d1ce-4416-9700-229b4c1c3797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:57.671008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-1c01eb3f-d1ce-4416-9700-229b4c1c3797 None None] MFA Rules not processed for user `c22a0fc8a3914f7fb3356a84827db326`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:57.672335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1c01eb3f-d1ce-4416-9700-229b4c1c3797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:57.684126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-00613b1c-9c00-44ce-977b-aa072a38cb98 None None] MFA Rules not processed for user `8522ae9773b84cb6a9bd381de20c9e30`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:57.689158 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-00613b1c-9c00-44ce-977b-aa072a38cb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:57.845613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 885/1762] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:48:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:57.887388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01eb3f-d1ce-4416-9700-229b4c1c3797 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:57.889801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1c01eb3f-d1ce-4416-9700-229b4c1c3797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:57.971511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01eb3f-d1ce-4416-9700-229b4c1c3797 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:57.990690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 878/1763] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:57.991529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9518-76b6-48ed-91a3-f21b1fd32dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:57.992237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9518-76b6-48ed-91a3-f21b1fd32dba service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:57.996221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9518-76b6-48ed-91a3-f21b1fd32dba service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:57.996563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9518-76b6-48ed-91a3-f21b1fd32dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:58.006814 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00613b1c-9c00-44ce-977b-aa072a38cb98 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:58.008391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-00613b1c-9c00-44ce-977b-aa072a38cb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:58.056017 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9518-76b6-48ed-91a3-f21b1fd32dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:58.073676 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9518-76b6-48ed-91a3-f21b1fd32dba service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:58.124478 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 886/1764] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:48:58.173148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00613b1c-9c00-44ce-977b-aa072a38cb98 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:58.181985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009cfc3-593b-4929-a469-6cb526b461a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:58.182293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009cfc3-593b-4929-a469-6cb526b461a1 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:58.182579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009cfc3-593b-4929-a469-6cb526b461a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:58.182855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009cfc3-593b-4929-a469-6cb526b461a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:58.204966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009cfc3-593b-4929-a469-6cb526b461a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:58.206878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009cfc3-593b-4929-a469-6cb526b461a1 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:58.238306 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9518-76b6-48ed-91a3-f21b1fd32dba service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:58.241208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d5fc9518-76b6-48ed-91a3-f21b1fd32dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:58.284182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 879/1765] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:48:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:48:58.473396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9518-76b6-48ed-91a3-f21b1fd32dba service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:58.489875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:58.491309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:58.491676 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:58.492123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] PATH_INFO: `/v3/projects/3da38b286e004405b81744905dcf74a2` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:58.495120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da38b286e004405b81744905dcf74a2)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:58.502121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:58.606324 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da38b286e004405b81744905dcf74a2', 'request_id': 'req-2fe1397d-3678-4633-91a5-545bc2c1c5b4'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:58.621472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da38b286e004405b81744905dcf74a2', 'request_id': 'req-2fe1397d-3678-4633-91a5-545bc2c1c5b4'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:58.634977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da38b286e004405b81744905dcf74a2', 'request_id': 'req-2fe1397d-3678-4633-91a5-545bc2c1c5b4'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:58.653649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] The token cache is being invalidate because project 3da38b286e004405b81744905dcf74a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:48:58.654091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:58.654863 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2fe1397d-3678-4633-91a5-545bc2c1c5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:48:58.662173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0472-a728-430b-91e7-71760b207278 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:58.662580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0472-a728-430b-91e7-71760b207278 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:58.662960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0472-a728-430b-91e7-71760b207278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:58.664482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 887/1766] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:48:58 2022] DELETE /identity/v3/projects/3da38b286e004405b81744905dcf74a2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:58.685460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-287b0472-a728-430b-91e7-71760b207278 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:58.688093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-287b0472-a728-430b-91e7-71760b207278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:58.821997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 880/1767] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:58.842265 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72684a9-2556-4a53-847a-05ae4d1bc9b7 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:58.842753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72684a9-2556-4a53-847a-05ae4d1bc9b7 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:58.843222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72684a9-2556-4a53-847a-05ae4d1bc9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:58.930072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d72684a9-2556-4a53-847a-05ae4d1bc9b7 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:58.932829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d72684a9-2556-4a53-847a-05ae4d1bc9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:58.951413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 888/1768] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:58.952403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b0472-a728-430b-91e7-71760b207278 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:58.976211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72684a9-2556-4a53-847a-05ae4d1bc9b7 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:58.977804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d72684a9-2556-4a53-847a-05ae4d1bc9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:58.986941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b0472-a728-430b-91e7-71760b207278 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:58.995430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985d950-e5fe-4c7b-aeee-c2e449f14d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:58.997103 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985d950-e5fe-4c7b-aeee-c2e449f14d7d admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:58.997621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985d950-e5fe-4c7b-aeee-c2e449f14d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:58.998122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985d950-e5fe-4c7b-aeee-c2e449f14d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:58.999254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985d950-e5fe-4c7b-aeee-c2e449f14d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:58.999839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985d950-e5fe-4c7b-aeee-c2e449f14d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:59.003162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985d950-e5fe-4c7b-aeee-c2e449f14d7d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:59.039031 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 881/1769] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:48:59.044077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985d950-e5fe-4c7b-aeee-c2e449f14d7d admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:59.090042 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985d950-e5fe-4c7b-aeee-c2e449f14d7d admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:59.097291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4605ed-39e3-4a00-86cd-4e3a0dc44c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:59.098271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4605ed-39e3-4a00-86cd-4e3a0dc44c36 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:59.098660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4605ed-39e3-4a00-86cd-4e3a0dc44c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:59.099357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4605ed-39e3-4a00-86cd-4e3a0dc44c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:59.100212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4605ed-39e3-4a00-86cd-4e3a0dc44c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:59.103105 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4605ed-39e3-4a00-86cd-4e3a0dc44c36 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:59.148634 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 882/1770] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:59 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:59.150921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd1e6e-7c5d-486f-83ed-d96a1835fb41 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:59.152040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd1e6e-7c5d-486f-83ed-d96a1835fb41 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:59.152596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd1e6e-7c5d-486f-83ed-d96a1835fb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:59.182089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-38dd1e6e-7c5d-486f-83ed-d96a1835fb41 None None] MFA Rules not processed for user `dab7aa55b2554d338cd76f34d03e1ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:48:59.184279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-38dd1e6e-7c5d-486f-83ed-d96a1835fb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:48:59.185396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72684a9-2556-4a53-847a-05ae4d1bc9b7 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:59.311059 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 883/1771] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:48:59.312274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd1e6e-7c5d-486f-83ed-d96a1835fb41 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:59.345846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca49842-209e-4bd2-a034-1d20310b9291 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8522ae9773b84cb6a9bd381de20c9e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46bfc4d6e1274482a27bbdc5144a7e4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:59.347164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca49842-209e-4bd2-a034-1d20310b9291 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:59.351004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca49842-209e-4bd2-a034-1d20310b9291 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:59.352684 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca49842-209e-4bd2-a034-1d20310b9291 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:59.354585 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca49842-209e-4bd2-a034-1d20310b9291 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:59.356151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca49842-209e-4bd2-a034-1d20310b9291 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:59.359640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca49842-209e-4bd2-a034-1d20310b9291 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:59.392079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 889/1772] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:59.392614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca49842-209e-4bd2-a034-1d20310b9291 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:59.427122 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca49842-209e-4bd2-a034-1d20310b9291 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:59.435353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d447d5-ed04-467f-bafd-fecd958af5fc tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8522ae9773b84cb6a9bd381de20c9e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46bfc4d6e1274482a27bbdc5144a7e4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:59.435353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d447d5-ed04-467f-bafd-fecd958af5fc tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:59.435353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d447d5-ed04-467f-bafd-fecd958af5fc tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:59.437746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d447d5-ed04-467f-bafd-fecd958af5fc tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:59.437746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d447d5-ed04-467f-bafd-fecd958af5fc tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:59.437895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d447d5-ed04-467f-bafd-fecd958af5fc tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:59.542496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 890/1773] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:48:59 2022] POST /identity/v3/projects => generated 355 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:59.544298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd1e6e-7c5d-486f-83ed-d96a1835fb41 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:59.549611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d447d5-ed04-467f-bafd-fecd958af5fc tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:59.649674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516de1d-0646-4e0c-98a5-22aa814c68c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:59.654323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516de1d-0646-4e0c-98a5-22aa814c68c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:59.657710 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516de1d-0646-4e0c-98a5-22aa814c68c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:59.658310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516de1d-0646-4e0c-98a5-22aa814c68c7 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:59.659288 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516de1d-0646-4e0c-98a5-22aa814c68c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:59.662486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516de1d-0646-4e0c-98a5-22aa814c68c7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:59.718230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 884/1774] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:48:59 2022] POST /identity/v3/users => generated 291 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:48:59.719323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516de1d-0646-4e0c-98a5-22aa814c68c7 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:59.738006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516de1d-0646-4e0c-98a5-22aa814c68c7 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:59.752690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c15ecb-788f-4656-81e8-b007ce8c012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:59.755486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15ecb-788f-4656-81e8-b007ce8c012c admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:59.757253 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15ecb-788f-4656-81e8-b007ce8c012c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:59.757768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15ecb-788f-4656-81e8-b007ce8c012c admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:59.760011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c15ecb-788f-4656-81e8-b007ce8c012c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:59.766023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c15ecb-788f-4656-81e8-b007ce8c012c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:59.766477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d447d5-ed04-467f-bafd-fecd958af5fc tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:59.793999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09b8e0-518d-4abc-aae8-15280e8d254f tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8522ae9773b84cb6a9bd381de20c9e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46bfc4d6e1274482a27bbdc5144a7e4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:59.796290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09b8e0-518d-4abc-aae8-15280e8d254f tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:59.796583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09b8e0-518d-4abc-aae8-15280e8d254f tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:59.796861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09b8e0-518d-4abc-aae8-15280e8d254f tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:59.803567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09b8e0-518d-4abc-aae8-15280e8d254f tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:48:59.804143 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09b8e0-518d-4abc-aae8-15280e8d254f tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:59.810768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 885/1775] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:59.811814 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c15ecb-788f-4656-81e8-b007ce8c012c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:59.813036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09b8e0-518d-4abc-aae8-15280e8d254f tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:59.834733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c15ecb-788f-4656-81e8-b007ce8c012c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:59.842053 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 891/1776] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:48:59.842248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac877e4-b3ab-44a6-bdb2-d2496f76b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:59.842248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac877e4-b3ab-44a6-bdb2-d2496f76b376 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:59.842669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac877e4-b3ab-44a6-bdb2-d2496f76b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:59.844589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac877e4-b3ab-44a6-bdb2-d2496f76b376 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:59.844589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac877e4-b3ab-44a6-bdb2-d2496f76b376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:59.845883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac877e4-b3ab-44a6-bdb2-d2496f76b376 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:59.859603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 886/1777] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:48:59.874612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09b8e0-518d-4abc-aae8-15280e8d254f tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:59.899674 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09b8e0-518d-4abc-aae8-15280e8d254f tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:59.906332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b8960-4a3a-4372-8175-b2a838b27cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:48:59.908327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b8960-4a3a-4372-8175-b2a838b27cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:59.908613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b8960-4a3a-4372-8175-b2a838b27cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:59.908947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b8960-4a3a-4372-8175-b2a838b27cfe admin admin] PATH_INFO: `/v3/projects/5fb4d71c25da40b78f1832e135dfb731/users/8ef51c43e7084760b9b9010eed6e6e6a/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:48:59.926846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b8960-4a3a-4372-8175-b2a838b27cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb4d71c25da40b78f1832e135dfb731, user_id=8ef51c43e7084760b9b9010eed6e6e6a, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:48:59.930780 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b8960-4a3a-4372-8175-b2a838b27cfe admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:48:59.960057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 892/1778] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:48:59 2022] PUT /identity/v3/projects/5fb4d71c25da40b78f1832e135dfb731/users/8ef51c43e7084760b9b9010eed6e6e6a/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:48:59.962152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac877e4-b3ab-44a6-bdb2-d2496f76b376 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:48:59.985180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbeec5-efec-4723-9d0a-617a68d134a0 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:48:59.987114 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac877e4-b3ab-44a6-bdb2-d2496f76b376 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:48:59.987808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbeec5-efec-4723-9d0a-617a68d134a0 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:48:59.988720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbeec5-efec-4723-9d0a-617a68d134a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:00.071203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d8fbeec5-efec-4723-9d0a-617a68d134a0 None None] MFA Rules not processed for user `8ef51c43e7084760b9b9010eed6e6e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:00.072659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d8fbeec5-efec-4723-9d0a-617a68d134a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:00.284794 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8522ae9773b84cb6a9bd381de20c9e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46bfc4d6e1274482a27bbdc5144a7e4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:00.288433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:00.288935 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:00.294118 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] PATH_INFO: `/v3/projects/7f5d1db1d4d9477fa74657e76dc4885c` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:00.300160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7f5d1db1d4d9477fa74657e76dc4885c)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:00.302877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:00.328663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 893/1779] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:48:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:00.334549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbeec5-efec-4723-9d0a-617a68d134a0 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:00.441926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f5d1db1d4d9477fa74657e76dc4885c', 'request_id': 'req-8909fd3d-2792-4319-a3c1-1fc7c73766c2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:00.464899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f5d1db1d4d9477fa74657e76dc4885c', 'request_id': 'req-8909fd3d-2792-4319-a3c1-1fc7c73766c2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:00.485940 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f5d1db1d4d9477fa74657e76dc4885c', 'request_id': 'req-8909fd3d-2792-4319-a3c1-1fc7c73766c2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:00.516209 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] The token cache is being invalidate because project 7f5d1db1d4d9477fa74657e76dc4885c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:00.516510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:00.518032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:00.520620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 887/1780] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:48:59 2022] DELETE /identity/v3/projects/7f5d1db1d4d9477fa74657e76dc4885c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:00.565316 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbeec5-efec-4723-9d0a-617a68d134a0 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:00.808499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13c2c2-c8f7-4f8e-8208-60b474cf4e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:00.809573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c2c2-c8f7-4f8e-8208-60b474cf4e84 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:00.810151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c2c2-c8f7-4f8e-8208-60b474cf4e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:00.810672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c2c2-c8f7-4f8e-8208-60b474cf4e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:00.811557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13c2c2-c8f7-4f8e-8208-60b474cf4e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:00.822830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13c2c2-c8f7-4f8e-8208-60b474cf4e84 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:00.924867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 894/1781] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:00 2022] POST /identity/v3/projects => generated 379 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:00.926775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:00.934019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:00.980030 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909fd3d-2792-4319-a3c1-1fc7c73766c2 tempest-VolumeQuotaClassesTest-1356058291 tempest-VolumeQuotaClassesTest-1356058291-project-admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:01.121820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee0b7e-ae17-4c81-b873-5efdf7bae9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:01.124608 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0b7e-ae17-4c81-b873-5efdf7bae9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:01.124904 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0b7e-ae17-4c81-b873-5efdf7bae9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:01.135920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0b7e-ae17-4c81-b873-5efdf7bae9d4 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:01.136768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee0b7e-ae17-4c81-b873-5efdf7bae9d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:01.152814 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee0b7e-ae17-4c81-b873-5efdf7bae9d4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:01.187643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13c2c2-c8f7-4f8e-8208-60b474cf4e84 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:01.190994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-fd13c2c2-c8f7-4f8e-8208-60b474cf4e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:01.224249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13c2c2-c8f7-4f8e-8208-60b474cf4e84 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:01.227587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7666495-c8ae-4bce-9d64-99d26a0f34fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:01.228968 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7666495-c8ae-4bce-9d64-99d26a0f34fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:01.229171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7666495-c8ae-4bce-9d64-99d26a0f34fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:01.229548 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7666495-c8ae-4bce-9d64-99d26a0f34fb admin admin] PATH_INFO: `/v3/users/06fc7534cf304568beda7130d62e9262` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:01.231297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7666495-c8ae-4bce-9d64-99d26a0f34fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fc7534cf304568beda7130d62e9262)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:01.233968 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7666495-c8ae-4bce-9d64-99d26a0f34fb admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:01.262110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 888/1782] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:00 2022] POST /identity/v3/users => generated 296 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:01.268421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee0b7e-ae17-4c81-b873-5efdf7bae9d4 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:01.294378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee0b7e-ae17-4c81-b873-5efdf7bae9d4 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:01.307288 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58ef54-89f5-4284-8a5b-1941209eba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:01.308250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58ef54-89f5-4284-8a5b-1941209eba30 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:01.308797 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58ef54-89f5-4284-8a5b-1941209eba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:01.319769 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58ef54-89f5-4284-8a5b-1941209eba30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:01.324828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58ef54-89f5-4284-8a5b-1941209eba30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:01.334013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58ef54-89f5-4284-8a5b-1941209eba30 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:01.335406 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-b7666495-c8ae-4bce-9d64-99d26a0f34fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fc7534cf304568beda7130d62e9262'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:01.370301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 889/1783] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:01.374767 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58ef54-89f5-4284-8a5b-1941209eba30 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:01.397594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-b7666495-c8ae-4bce-9d64-99d26a0f34fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fc7534cf304568beda7130d62e9262'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:01.398320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-b7666495-c8ae-4bce-9d64-99d26a0f34fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fc7534cf304568beda7130d62e9262'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:01.412892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-b7666495-c8ae-4bce-9d64-99d26a0f34fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fc7534cf304568beda7130d62e9262'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:01.414593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58ef54-89f5-4284-8a5b-1941209eba30 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:01.426457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93d17-08f6-43b9-8a98-f3228b7340f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:01.427642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93d17-08f6-43b9-8a98-f3228b7340f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:01.428075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93d17-08f6-43b9-8a98-f3228b7340f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:01.428453 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93d17-08f6-43b9-8a98-f3228b7340f9 admin admin] PATH_INFO: `/v3/projects/35afb726ebe5448a9794d1bd024c093c/users/4d64a970355e4ba4ac0715136787a089/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:01.432709 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-b7666495-c8ae-4bce-9d64-99d26a0f34fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fc7534cf304568beda7130d62e9262'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:01.445497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 895/1784] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:01 2022] DELETE /identity/v3/users/06fc7534cf304568beda7130d62e9262 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:01.445497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6c9b-b9ff-4de4-abe2-70612b624cb6 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:01.445497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6c9b-b9ff-4de4-abe2-70612b624cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:01.445830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6c9b-b9ff-4de4-abe2-70612b624cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:01.450219 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d93d17-08f6-43b9-8a98-f3228b7340f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35afb726ebe5448a9794d1bd024c093c, user_id=4d64a970355e4ba4ac0715136787a089, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:01.456496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d93d17-08f6-43b9-8a98-f3228b7340f9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:01.487193 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 890/1785] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:01 2022] PUT /identity/v3/projects/35afb726ebe5448a9794d1bd024c093c/users/4d64a970355e4ba4ac0715136787a089/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:01.491614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93d17-08f6-43b9-8a98-f3228b7340f9 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:01.495085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c4d93d17-08f6-43b9-8a98-f3228b7340f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:01.509635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-760d6c9b-b9ff-4de4-abe2-70612b624cb6 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:01.509635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-760d6c9b-b9ff-4de4-abe2-70612b624cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:01.686043 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93d17-08f6-43b9-8a98-f3228b7340f9 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:01.694963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecc1fb-adac-410b-8833-4054af1cdda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:01.696186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc1fb-adac-410b-8833-4054af1cdda4 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:01.696737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc1fb-adac-410b-8833-4054af1cdda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:01.697297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc1fb-adac-410b-8833-4054af1cdda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:01.698368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecc1fb-adac-410b-8833-4054af1cdda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:01.700971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecc1fb-adac-410b-8833-4054af1cdda4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:01.718249 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 891/1786] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:01.724458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecc1fb-adac-410b-8833-4054af1cdda4 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:01.737076 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 896/1787] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:01.749276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecc1fb-adac-410b-8833-4054af1cdda4 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:01.756325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6c9b-b9ff-4de4-abe2-70612b624cb6 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:01.758294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-760d6c9b-b9ff-4de4-abe2-70612b624cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:01.760254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed4e2f-1c30-46d4-bb51-b18e34e28e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:01.762151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed4e2f-1c30-46d4-bb51-b18e34e28e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:01.763364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed4e2f-1c30-46d4-bb51-b18e34e28e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:01.763364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed4e2f-1c30-46d4-bb51-b18e34e28e73 admin admin] PATH_INFO: `/v3/projects/35afb726ebe5448a9794d1bd024c093c/users/4d64a970355e4ba4ac0715136787a089/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:01.767036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed4e2f-1c30-46d4-bb51-b18e34e28e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35afb726ebe5448a9794d1bd024c093c, user_id=4d64a970355e4ba4ac0715136787a089, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:01.772260 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed4e2f-1c30-46d4-bb51-b18e34e28e73 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:01.812720 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 892/1788] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:01 2022] PUT /identity/v3/projects/35afb726ebe5448a9794d1bd024c093c/users/4d64a970355e4ba4ac0715136787a089/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:01.814208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d69816-b1a5-4cc0-bdee-e9645fb26a3e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:01.814894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d69816-b1a5-4cc0-bdee-e9645fb26a3e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:01.815199 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d69816-b1a5-4cc0-bdee-e9645fb26a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:01.866969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-36d69816-b1a5-4cc0-bdee-e9645fb26a3e None None] MFA Rules not processed for user `4d64a970355e4ba4ac0715136787a089`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:01.869049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-36d69816-b1a5-4cc0-bdee-e9645fb26a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:01.886681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6c9b-b9ff-4de4-abe2-70612b624cb6 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:01.982051 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 893/1789] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:01.984809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947d60-6959-42b6-ad00-e677d4e8bb99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:01.985562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947d60-6959-42b6-ad00-e677d4e8bb99 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:01.985913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947d60-6959-42b6-ad00-e677d4e8bb99 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:01.986202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947d60-6959-42b6-ad00-e677d4e8bb99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:01.997002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d69816-b1a5-4cc0-bdee-e9645fb26a3e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:01.998543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-36d69816-b1a5-4cc0-bdee-e9645fb26a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:02.075282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d69816-b1a5-4cc0-bdee-e9645fb26a3e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:02.085483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5886f-b0bd-424f-a908-06e89006964b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:02.086455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5886f-b0bd-424f-a908-06e89006964b service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:02.087591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5886f-b0bd-424f-a908-06e89006964b service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:02.089188 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5886f-b0bd-424f-a908-06e89006964b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:02.123369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6947d60-6959-42b6-ad00-e677d4e8bb99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:02.125068 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6947d60-6959-42b6-ad00-e677d4e8bb99 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:02.145090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5886f-b0bd-424f-a908-06e89006964b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:02.148017 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5886f-b0bd-424f-a908-06e89006964b service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:02.158147 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 897/1790] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:02.174974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 894/1791] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:49:02.738684 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947d60-6959-42b6-ad00-e677d4e8bb99 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:02.755379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947d60-6959-42b6-ad00-e677d4e8bb99 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:02.784530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731efb9b-3289-4b82-b02a-723bdd1c23c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:02.785525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731efb9b-3289-4b82-b02a-723bdd1c23c4 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:02.785950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731efb9b-3289-4b82-b02a-723bdd1c23c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:02.786466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731efb9b-3289-4b82-b02a-723bdd1c23c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:02.796610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-731efb9b-3289-4b82-b02a-723bdd1c23c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:02.985984 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731efb9b-3289-4b82-b02a-723bdd1c23c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:02.988827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731efb9b-3289-4b82-b02a-723bdd1c23c4 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:03.026980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 898/1792] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:03.193640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5886f-b0bd-424f-a908-06e89006964b service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:03.196159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-47c5886f-b0bd-424f-a908-06e89006964b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:03.217516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5886f-b0bd-424f-a908-06e89006964b service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:03.249396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:03.250779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:03.260176 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:03.260176 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] PATH_INFO: `/v3/projects/95d2e824ebea43fba3453a7ee3215b04` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:03.264087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d2e824ebea43fba3453a7ee3215b04)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:03.269972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:03.382781 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d2e824ebea43fba3453a7ee3215b04', 'request_id': 'req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:03.389501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d2e824ebea43fba3453a7ee3215b04', 'request_id': 'req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:03.398606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d2e824ebea43fba3453a7ee3215b04', 'request_id': 'req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:03.411030 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] The token cache is being invalidate because project 95d2e824ebea43fba3453a7ee3215b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:03.412027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:03.412705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:03.414346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 895/1793] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:03 2022] DELETE /identity/v3/projects/95d2e824ebea43fba3453a7ee3215b04 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:03.418359 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731efb9b-3289-4b82-b02a-723bdd1c23c4 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:03.429222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731efb9b-3289-4b82-b02a-723bdd1c23c4 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:03.494845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a04b26-6e64-4c88-9230-8a1e55f08d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:03.495766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a04b26-6e64-4c88-9230-8a1e55f08d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:03.496049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a04b26-6e64-4c88-9230-8a1e55f08d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:03.496319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a04b26-6e64-4c88-9230-8a1e55f08d05 admin admin] PATH_INFO: `/v3/users/8522ae9773b84cb6a9bd381de20c9e30` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:03.497538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a04b26-6e64-4c88-9230-8a1e55f08d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8522ae9773b84cb6a9bd381de20c9e30)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:03.499486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a04b26-6e64-4c88-9230-8a1e55f08d05 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:03.557857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-80a04b26-6e64-4c88-9230-8a1e55f08d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8522ae9773b84cb6a9bd381de20c9e30'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:03.569973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-80a04b26-6e64-4c88-9230-8a1e55f08d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8522ae9773b84cb6a9bd381de20c9e30'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:03.570712 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-80a04b26-6e64-4c88-9230-8a1e55f08d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8522ae9773b84cb6a9bd381de20c9e30'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:03.578412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-80a04b26-6e64-4c88-9230-8a1e55f08d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8522ae9773b84cb6a9bd381de20c9e30'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:03.585939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-80a04b26-6e64-4c88-9230-8a1e55f08d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8522ae9773b84cb6a9bd381de20c9e30'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:03.592111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 899/1794] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:03 2022] DELETE /identity/v3/users/8522ae9773b84cb6a9bd381de20c9e30 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:03.861576 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:03.863149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:03.879739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbf691-8c6b-4bbc-a755-e43c4da6c486 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:03.941633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:03.942623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:03.942910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:03.943184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] PATH_INFO: `/v3/projects/46bfc4d6e1274482a27bbdc5144a7e4e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:03.944586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bfc4d6e1274482a27bbdc5144a7e4e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:03.946756 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.009215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bfc4d6e1274482a27bbdc5144a7e4e', 'request_id': 'req-a9bfb3f8-bd0e-4313-a235-42867482985b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:04.019515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bfc4d6e1274482a27bbdc5144a7e4e', 'request_id': 'req-a9bfb3f8-bd0e-4313-a235-42867482985b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:04.029581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bfc4d6e1274482a27bbdc5144a7e4e', 'request_id': 'req-a9bfb3f8-bd0e-4313-a235-42867482985b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:04.043941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] The token cache is being invalidate because project 46bfc4d6e1274482a27bbdc5144a7e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:04.044233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:04.044912 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a9bfb3f8-bd0e-4313-a235-42867482985b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:04.046489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 896/1795] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:03 2022] DELETE /identity/v3/projects/46bfc4d6e1274482a27bbdc5144a7e4e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:04.051612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274dac-667e-4805-bf85-6470f4a5613d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.052304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274dac-667e-4805-bf85-6470f4a5613d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.052998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274dac-667e-4805-bf85-6470f4a5613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.072771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-05274dac-667e-4805-bf85-6470f4a5613d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:04.073942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-05274dac-667e-4805-bf85-6470f4a5613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:04.133972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 900/1796] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:04.141769 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78367-3278-4bb6-a5b7-eb5bb85bdb40 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.142085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78367-3278-4bb6-a5b7-eb5bb85bdb40 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.142612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a78367-3278-4bb6-a5b7-eb5bb85bdb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.164989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-52a78367-3278-4bb6-a5b7-eb5bb85bdb40 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:04.166201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-52a78367-3278-4bb6-a5b7-eb5bb85bdb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:04.174401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 897/1797] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:04.178927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05274dac-667e-4805-bf85-6470f4a5613d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:04.188742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05274dac-667e-4805-bf85-6470f4a5613d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:04.193402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275c5fe-0352-4e7a-b033-51ab2d8c89f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:04.194063 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275c5fe-0352-4e7a-b033-51ab2d8c89f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.194344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275c5fe-0352-4e7a-b033-51ab2d8c89f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.194652 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275c5fe-0352-4e7a-b033-51ab2d8c89f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.195449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275c5fe-0352-4e7a-b033-51ab2d8c89f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:49:04.195808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275c5fe-0352-4e7a-b033-51ab2d8c89f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:04.197485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275c5fe-0352-4e7a-b033-51ab2d8c89f8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.210124 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 901/1798] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:49:04.214942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a78367-3278-4bb6-a5b7-eb5bb85bdb40 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:04.224824 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a78367-3278-4bb6-a5b7-eb5bb85bdb40 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:04.229417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd087e-347d-4235-969d-d9c847fc9320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:04.230063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd087e-347d-4235-969d-d9c847fc9320 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.230344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd087e-347d-4235-969d-d9c847fc9320 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.231014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd087e-347d-4235-969d-d9c847fc9320 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.231318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd087e-347d-4235-969d-d9c847fc9320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:04.233257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd087e-347d-4235-969d-d9c847fc9320 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.258636 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 898/1799] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:04 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:49:04.263976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275c5fe-0352-4e7a-b033-51ab2d8c89f8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:04.275592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275c5fe-0352-4e7a-b033-51ab2d8c89f8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:04.349639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5cbb8-ea69-4803-9d77-8c6f545effc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:04.350326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5cbb8-ea69-4803-9d77-8c6f545effc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.350611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5cbb8-ea69-4803-9d77-8c6f545effc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.350888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5cbb8-ea69-4803-9d77-8c6f545effc2 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.351622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5cbb8-ea69-4803-9d77-8c6f545effc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:04.353592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5cbb8-ea69-4803-9d77-8c6f545effc2 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.374976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 902/1800] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:04 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:04.379506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd087e-347d-4235-969d-d9c847fc9320 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:04.390261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd087e-347d-4235-969d-d9c847fc9320 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:04.395124 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da9dc8-8891-47ca-9dd0-4a049387b515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:04.396611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9dc8-8891-47ca-9dd0-4a049387b515 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.397096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9dc8-8891-47ca-9dd0-4a049387b515 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.397563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9dc8-8891-47ca-9dd0-4a049387b515 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.398476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da9dc8-8891-47ca-9dd0-4a049387b515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:04.400131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da9dc8-8891-47ca-9dd0-4a049387b515 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.412668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 899/1801] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:04.416664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5cbb8-ea69-4803-9d77-8c6f545effc2 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:04.427994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5cbb8-ea69-4803-9d77-8c6f545effc2 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:04.432920 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbb5cf-01d7-44c8-8b20-00c5a3340f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:04.433606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb5cf-01d7-44c8-8b20-00c5a3340f2a admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.434044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb5cf-01d7-44c8-8b20-00c5a3340f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.434330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb5cf-01d7-44c8-8b20-00c5a3340f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.435180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbb5cf-01d7-44c8-8b20-00c5a3340f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:04.436696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbb5cf-01d7-44c8-8b20-00c5a3340f2a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.449887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 903/1802] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:04.453843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da9dc8-8891-47ca-9dd0-4a049387b515 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:04.468900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da9dc8-8891-47ca-9dd0-4a049387b515 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:04.474944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c11a3-d788-4aca-bd47-77e01f915191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:04.475959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c11a3-d788-4aca-bd47-77e01f915191 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.476336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c11a3-d788-4aca-bd47-77e01f915191 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.476680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c11a3-d788-4aca-bd47-77e01f915191 admin admin] PATH_INFO: `/v3/projects/a6ac631b8cb64af8bfcb977130dcea49/users/b5537202a7d84766a8f7ba60b478cffd/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.491917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c11a3-d788-4aca-bd47-77e01f915191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ac631b8cb64af8bfcb977130dcea49, user_id=b5537202a7d84766a8f7ba60b478cffd, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:04.494592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c11a3-d788-4aca-bd47-77e01f915191 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.508640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 900/1803] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:04 2022] PUT /identity/v3/projects/a6ac631b8cb64af8bfcb977130dcea49/users/b5537202a7d84766a8f7ba60b478cffd/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:04.520250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fbaaa-33b2-4e6f-892f-1737423539cc None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.520547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fbaaa-33b2-4e6f-892f-1737423539cc None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.521585 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fbaaa-33b2-4e6f-892f-1737423539cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.550303 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-5f9fbaaa-33b2-4e6f-892f-1737423539cc None None] MFA Rules not processed for user `b5537202a7d84766a8f7ba60b478cffd`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:04.552215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5f9fbaaa-33b2-4e6f-892f-1737423539cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:04.627990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 904/1804] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:04.632143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c11a3-d788-4aca-bd47-77e01f915191 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:04.702246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c11a3-d788-4aca-bd47-77e01f915191 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:04.707173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faa27f-20de-486b-945b-9f56a51a0163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:04.707894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faa27f-20de-486b-945b-9f56a51a0163 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.708773 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faa27f-20de-486b-945b-9f56a51a0163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.709019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faa27f-20de-486b-945b-9f56a51a0163 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.710101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faa27f-20de-486b-945b-9f56a51a0163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:04.712092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faa27f-20de-486b-945b-9f56a51a0163 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.742599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 901/1805] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:04 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:04.743970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fbaaa-33b2-4e6f-892f-1737423539cc None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:04.757027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fbaaa-33b2-4e6f-892f-1737423539cc None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:04.824606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427c869-eb21-46e8-81d4-102672de9803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:04.825283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427c869-eb21-46e8-81d4-102672de9803 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.825559 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427c869-eb21-46e8-81d4-102672de9803 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.825856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427c869-eb21-46e8-81d4-102672de9803 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.826550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427c869-eb21-46e8-81d4-102672de9803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:04.828494 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427c869-eb21-46e8-81d4-102672de9803 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.849979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 905/1806] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:04 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:04.854256 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faa27f-20de-486b-945b-9f56a51a0163 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:04.865015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faa27f-20de-486b-945b-9f56a51a0163 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:04.869665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb42e3-ed25-46a9-8464-ca74a349a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:04.870335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb42e3-ed25-46a9-8464-ca74a349a741 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.870616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb42e3-ed25-46a9-8464-ca74a349a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.870924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb42e3-ed25-46a9-8464-ca74a349a741 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.871653 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb42e3-ed25-46a9-8464-ca74a349a741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:04.873282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb42e3-ed25-46a9-8464-ca74a349a741 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.884802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 902/1807] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:04.888934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427c869-eb21-46e8-81d4-102672de9803 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:04.899230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427c869-eb21-46e8-81d4-102672de9803 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:04.904061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c499d36-afba-43fd-8e07-29747c570d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:04.904877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499d36-afba-43fd-8e07-29747c570d17 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.905162 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499d36-afba-43fd-8e07-29747c570d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.905436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499d36-afba-43fd-8e07-29747c570d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.906179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c499d36-afba-43fd-8e07-29747c570d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:04.907801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c499d36-afba-43fd-8e07-29747c570d17 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.918484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 906/1808] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:04.922654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb42e3-ed25-46a9-8464-ca74a349a741 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:04.933524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb42e3-ed25-46a9-8464-ca74a349a741 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:04.938306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175584fa-7651-4278-8e58-d927861354f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:04.939226 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175584fa-7651-4278-8e58-d927861354f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.939627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175584fa-7651-4278-8e58-d927861354f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.939944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175584fa-7651-4278-8e58-d927861354f7 admin admin] PATH_INFO: `/v3/projects/1020cefba3cb4b0b845963b306943fcf/users/0d9fa9c38e3e41bd9bda525e2025b262/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:04.955637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175584fa-7651-4278-8e58-d927861354f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1020cefba3cb4b0b845963b306943fcf, user_id=0d9fa9c38e3e41bd9bda525e2025b262, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:04.958465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175584fa-7651-4278-8e58-d927861354f7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:04.972657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 903/1809] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:04 2022] PUT /identity/v3/projects/1020cefba3cb4b0b845963b306943fcf/users/0d9fa9c38e3e41bd9bda525e2025b262/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:04.982952 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5131544-f4e0-4bf0-a23a-1791a2d8cbde None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:04.983235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5131544-f4e0-4bf0-a23a-1791a2d8cbde None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:04.983512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5131544-f4e0-4bf0-a23a-1791a2d8cbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:05.011070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d5131544-f4e0-4bf0-a23a-1791a2d8cbde None None] MFA Rules not processed for user `0d9fa9c38e3e41bd9bda525e2025b262`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:05.012417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d5131544-f4e0-4bf0-a23a-1791a2d8cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:05.075961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 907/1810] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:05.080591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175584fa-7651-4278-8e58-d927861354f7 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:05.155825 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175584fa-7651-4278-8e58-d927861354f7 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:05.160482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5850d6f-f55e-40ce-a864-f75058a4d2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:05.161152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5850d6f-f55e-40ce-a864-f75058a4d2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:05.162006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5850d6f-f55e-40ce-a864-f75058a4d2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:05.162281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5850d6f-f55e-40ce-a864-f75058a4d2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:05.162976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5850d6f-f55e-40ce-a864-f75058a4d2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:05.164951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5850d6f-f55e-40ce-a864-f75058a4d2b2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:05.191624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 904/1811] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:05 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:49:05.196245 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5131544-f4e0-4bf0-a23a-1791a2d8cbde None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:05.207691 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5131544-f4e0-4bf0-a23a-1791a2d8cbde None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:05.267114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cf6f8-0528-4139-9a55-82d179759de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:05.267828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cf6f8-0528-4139-9a55-82d179759de4 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:05.268112 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cf6f8-0528-4139-9a55-82d179759de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:05.268389 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cf6f8-0528-4139-9a55-82d179759de4 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:05.269088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cf6f8-0528-4139-9a55-82d179759de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:05.271953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cf6f8-0528-4139-9a55-82d179759de4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:05.292701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 908/1812] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:05 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:05.296768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5850d6f-f55e-40ce-a864-f75058a4d2b2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:05.307343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5850d6f-f55e-40ce-a864-f75058a4d2b2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:05.312035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d86a-281f-4e8e-a6d1-37f5de223399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:05.312720 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d86a-281f-4e8e-a6d1-37f5de223399 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:05.313007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d86a-281f-4e8e-a6d1-37f5de223399 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:05.313284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d86a-281f-4e8e-a6d1-37f5de223399 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:05.314025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697d86a-281f-4e8e-a6d1-37f5de223399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:05.315633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697d86a-281f-4e8e-a6d1-37f5de223399 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:05.327600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 905/1813] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:49:05.331898 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cf6f8-0528-4139-9a55-82d179759de4 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:05.343900 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cf6f8-0528-4139-9a55-82d179759de4 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:05.349812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adfa76-c467-496d-a4ab-212b60e4087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:05.350834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adfa76-c467-496d-a4ab-212b60e4087e admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:05.351210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adfa76-c467-496d-a4ab-212b60e4087e admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:05.351555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adfa76-c467-496d-a4ab-212b60e4087e admin admin] PATH_INFO: `/v3/projects/1d1278a5796449969535df5c5e5edb08/users/ae00b79bd6574a69803310780e55a12b/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:05.378747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adfa76-c467-496d-a4ab-212b60e4087e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1278a5796449969535df5c5e5edb08, user_id=ae00b79bd6574a69803310780e55a12b, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:05.383086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adfa76-c467-496d-a4ab-212b60e4087e admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:05.398492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 909/1814] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:05 2022] PUT /identity/v3/projects/1d1278a5796449969535df5c5e5edb08/users/ae00b79bd6574a69803310780e55a12b/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:05.402543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d86a-281f-4e8e-a6d1-37f5de223399 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:05.413308 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d86a-281f-4e8e-a6d1-37f5de223399 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:05.471611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c5c52-f806-4411-b890-12ac8f3d23cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:05.472610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c5c52-f806-4411-b890-12ac8f3d23cc admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:05.472905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c5c52-f806-4411-b890-12ac8f3d23cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:05.473188 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c5c52-f806-4411-b890-12ac8f3d23cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:05.474102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c5c52-f806-4411-b890-12ac8f3d23cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:05.475702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c5c52-f806-4411-b890-12ac8f3d23cc admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:05.487363 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 906/1815] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:49:05.491785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adfa76-c467-496d-a4ab-212b60e4087e admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:05.502215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adfa76-c467-496d-a4ab-212b60e4087e admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:05.509596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b787b9-a098-4375-9559-80af55c98238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:05.510647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b787b9-a098-4375-9559-80af55c98238 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:05.510928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b787b9-a098-4375-9559-80af55c98238 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:05.511200 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b787b9-a098-4375-9559-80af55c98238 admin admin] PATH_INFO: `/v3/projects/1d1278a5796449969535df5c5e5edb08/users/ae00b79bd6574a69803310780e55a12b/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:05.513247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b787b9-a098-4375-9559-80af55c98238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1278a5796449969535df5c5e5edb08, user_id=ae00b79bd6574a69803310780e55a12b, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:05.516158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b787b9-a098-4375-9559-80af55c98238 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:05.528677 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 910/1816] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:05 2022] PUT /identity/v3/projects/1d1278a5796449969535df5c5e5edb08/users/ae00b79bd6574a69803310780e55a12b/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:05.539399 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba361-e6c2-4d10-b14c-46ac4c98a88b None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:05.539688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba361-e6c2-4d10-b14c-46ac4c98a88b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:05.540150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba361-e6c2-4d10-b14c-46ac4c98a88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:05.571120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-350ba361-e6c2-4d10-b14c-46ac4c98a88b None None] MFA Rules not processed for user `ae00b79bd6574a69803310780e55a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:05.572548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-350ba361-e6c2-4d10-b14c-46ac4c98a88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:05.641102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 907/1817] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:05.652277 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b787b9-a098-4375-9559-80af55c98238 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:05.654001 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a3b787b9-a098-4375-9559-80af55c98238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:05.712155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b787b9-a098-4375-9559-80af55c98238 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:05.715996 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95d111-a1bc-4e39-af1b-2dff535e48e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:05.716656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d111-a1bc-4e39-af1b-2dff535e48e9 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:05.716938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d111-a1bc-4e39-af1b-2dff535e48e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:05.717207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d111-a1bc-4e39-af1b-2dff535e48e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:05.727388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95d111-a1bc-4e39-af1b-2dff535e48e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:05.728863 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95d111-a1bc-4e39-af1b-2dff535e48e9 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:05.739187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 911/1818] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:06.459903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ba361-e6c2-4d10-b14c-46ac4c98a88b None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:06.486740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ba361-e6c2-4d10-b14c-46ac4c98a88b None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:06.495241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692501d-b12b-4583-81a2-8a17cfe95041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:06.496776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692501d-b12b-4583-81a2-8a17cfe95041 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:06.497605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692501d-b12b-4583-81a2-8a17cfe95041 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:06.498116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692501d-b12b-4583-81a2-8a17cfe95041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:06.571012 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692501d-b12b-4583-81a2-8a17cfe95041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:06.572508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692501d-b12b-4583-81a2-8a17cfe95041 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:06.587858 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 908/1819] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:21.161544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd7d57-5360-4406-96ad-5264a50aa43a None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:21.162655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd7d57-5360-4406-96ad-5264a50aa43a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:21.163165 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd7d57-5360-4406-96ad-5264a50aa43a None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:21.165021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 912/1820] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:49:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:49:21.190878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f7ebf-2c64-45e8-b0a1-f121e742c5e3 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:21.191851 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f7ebf-2c64-45e8-b0a1-f121e742c5e3 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:21.192329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f7ebf-2c64-45e8-b0a1-f121e742c5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:21.250937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-369f7ebf-2c64-45e8-b0a1-f121e742c5e3 None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:21.256032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-369f7ebf-2c64-45e8-b0a1-f121e742c5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:21.532100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 909/1821] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:49:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:21.722844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf88450-706c-4009-a42a-71cb0d7fa73a None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:21.723860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf88450-706c-4009-a42a-71cb0d7fa73a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:21.724224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf88450-706c-4009-a42a-71cb0d7fa73a None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:21.726415 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 913/1822] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:49:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:49:21.749149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab172c2-cbe7-4a93-9f7c-0f3bef56a115 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:21.749472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab172c2-cbe7-4a93-9f7c-0f3bef56a115 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:21.751350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab172c2-cbe7-4a93-9f7c-0f3bef56a115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:21.760118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf88450-706c-4009-a42a-71cb0d7fa73a None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:21.762308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9cf88450-706c-4009-a42a-71cb0d7fa73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:21.800048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf88450-706c-4009-a42a-71cb0d7fa73a None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:21.808660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-aab172c2-cbe7-4a93-9f7c-0f3bef56a115 None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:21.809931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-aab172c2-cbe7-4a93-9f7c-0f3bef56a115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:21.811600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb0832-0083-486a-8d2e-0792437d2354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:21.813182 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb0832-0083-486a-8d2e-0792437d2354 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:21.813482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb0832-0083-486a-8d2e-0792437d2354 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:21.813766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb0832-0083-486a-8d2e-0792437d2354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:21.846048 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 910/1823] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:49:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:21.937141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb0832-0083-486a-8d2e-0792437d2354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:21.939221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb0832-0083-486a-8d2e-0792437d2354 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:21.952678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 914/1824] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:22.024537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab172c2-cbe7-4a93-9f7c-0f3bef56a115 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:22.026184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-aab172c2-cbe7-4a93-9f7c-0f3bef56a115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:22.067134 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab172c2-cbe7-4a93-9f7c-0f3bef56a115 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:22.076758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844a3ed-435a-458a-a22d-8241f438ad5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:22.078175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844a3ed-435a-458a-a22d-8241f438ad5a service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:22.080548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844a3ed-435a-458a-a22d-8241f438ad5a service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:22.081068 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844a3ed-435a-458a-a22d-8241f438ad5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:22.099887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844a3ed-435a-458a-a22d-8241f438ad5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:22.102119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844a3ed-435a-458a-a22d-8241f438ad5a service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:22.132159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 911/1825] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:22.423241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb0832-0083-486a-8d2e-0792437d2354 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:22.425159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-10fb0832-0083-486a-8d2e-0792437d2354 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:22.459111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb0832-0083-486a-8d2e-0792437d2354 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:22.491523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea0e93-22da-4609-82fd-74459576f36a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:22.492773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea0e93-22da-4609-82fd-74459576f36a service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:22.493580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea0e93-22da-4609-82fd-74459576f36a service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:22.494410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea0e93-22da-4609-82fd-74459576f36a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:22.529284 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea0e93-22da-4609-82fd-74459576f36a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:22.529284 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea0e93-22da-4609-82fd-74459576f36a service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:22.555157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 915/1826] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:23.588153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844a3ed-435a-458a-a22d-8241f438ad5a service nova] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:23.592764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3844a3ed-435a-458a-a22d-8241f438ad5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:23.676139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844a3ed-435a-458a-a22d-8241f438ad5a service nova] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:23.682091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:23.683108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:23.683470 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:23.683866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] PATH_INFO: `/v3/users/8ef51c43e7084760b9b9010eed6e6e6a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:23.685270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef51c43e7084760b9b9010eed6e6e6a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:23.687472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:23.746342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef51c43e7084760b9b9010eed6e6e6a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:23.761535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef51c43e7084760b9b9010eed6e6e6a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:23.762313 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef51c43e7084760b9b9010eed6e6e6a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:23.762934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef51c43e7084760b9b9010eed6e6e6a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:23.772736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef51c43e7084760b9b9010eed6e6e6a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:23.788026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 912/1827] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:23 2022] DELETE /identity/v3/users/8ef51c43e7084760b9b9010eed6e6e6a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:23.793246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e58b3-17a3-478e-93a4-af580f2000a4 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:23.793798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e58b3-17a3-478e-93a4-af580f2000a4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:23.793798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e58b3-17a3-478e-93a4-af580f2000a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:23.818514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-175e58b3-17a3-478e-93a4-af580f2000a4 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:23.819801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-175e58b3-17a3-478e-93a4-af580f2000a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:23.888811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 916/1828] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:23.899256 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:23.900693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:23.968164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acf78f-1cec-4348-a497-d0296f088ded admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:23.972009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4dfea-cbc0-4b69-bcf2-6d295ac1442b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:23.972716 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4dfea-cbc0-4b69-bcf2-6d295ac1442b service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:23.973035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4dfea-cbc0-4b69-bcf2-6d295ac1442b service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:23.973316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4dfea-cbc0-4b69-bcf2-6d295ac1442b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:23.983458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4dfea-cbc0-4b69-bcf2-6d295ac1442b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:23.984975 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4dfea-cbc0-4b69-bcf2-6d295ac1442b service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:23.995600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 913/1829] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:24.346428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e58b3-17a3-478e-93a4-af580f2000a4 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:24.348036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-175e58b3-17a3-478e-93a4-af580f2000a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:24.362071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e58b3-17a3-478e-93a4-af580f2000a4 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:24.367597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:24.368617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:24.368834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:24.369112 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] PATH_INFO: `/v3/projects/5fb4d71c25da40b78f1832e135dfb731` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:24.370615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb4d71c25da40b78f1832e135dfb731)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:24.372650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:24.423972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb4d71c25da40b78f1832e135dfb731', 'request_id': 'req-92eeb906-3f70-4ce9-b480-7cc2cdd13254'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:24.430631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb4d71c25da40b78f1832e135dfb731', 'request_id': 'req-92eeb906-3f70-4ce9-b480-7cc2cdd13254'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:24.439328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb4d71c25da40b78f1832e135dfb731', 'request_id': 'req-92eeb906-3f70-4ce9-b480-7cc2cdd13254'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:24.451336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] The token cache is being invalidate because project 5fb4d71c25da40b78f1832e135dfb731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:24.451629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:24.452336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:24.453950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 917/1830] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:24 2022] DELETE /identity/v3/projects/5fb4d71c25da40b78f1832e135dfb731 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:24.459217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4dfea-cbc0-4b69-bcf2-6d295ac1442b service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:24.469489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4dfea-cbc0-4b69-bcf2-6d295ac1442b service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:24.537534 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebe718-519b-4d43-918c-b181716d09d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:24.538454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebe718-519b-4d43-918c-b181716d09d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:24.538740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebe718-519b-4d43-918c-b181716d09d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:24.539021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebe718-519b-4d43-918c-b181716d09d5 admin admin] PATH_INFO: `/v3/users/4d64a970355e4ba4ac0715136787a089` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:24.540359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebe718-519b-4d43-918c-b181716d09d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d64a970355e4ba4ac0715136787a089)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:24.542626 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebe718-519b-4d43-918c-b181716d09d5 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:24.608379 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-67ebe718-519b-4d43-918c-b181716d09d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d64a970355e4ba4ac0715136787a089'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:24.622817 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-67ebe718-519b-4d43-918c-b181716d09d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d64a970355e4ba4ac0715136787a089'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:24.623476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-67ebe718-519b-4d43-918c-b181716d09d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d64a970355e4ba4ac0715136787a089'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:24.624113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-67ebe718-519b-4d43-918c-b181716d09d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d64a970355e4ba4ac0715136787a089'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:24.634104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-67ebe718-519b-4d43-918c-b181716d09d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d64a970355e4ba4ac0715136787a089'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:24.657934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 914/1831] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:24 2022] DELETE /identity/v3/users/4d64a970355e4ba4ac0715136787a089 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:25.077122 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:25.078800 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:25.097641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eeb906-3f70-4ce9-b480-7cc2cdd13254 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:25.193565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:25.194493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:25.194780 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:25.195060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] PATH_INFO: `/v3/projects/35afb726ebe5448a9794d1bd024c093c` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:25.196371 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35afb726ebe5448a9794d1bd024c093c)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:25.198320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:25.246507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35afb726ebe5448a9794d1bd024c093c', 'request_id': 'req-1f942c93-e3af-405d-9fdc-fa738df429f7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:25.252861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35afb726ebe5448a9794d1bd024c093c', 'request_id': 'req-1f942c93-e3af-405d-9fdc-fa738df429f7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:25.261580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35afb726ebe5448a9794d1bd024c093c', 'request_id': 'req-1f942c93-e3af-405d-9fdc-fa738df429f7'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:25.273054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] The token cache is being invalidate because project 35afb726ebe5448a9794d1bd024c093c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:25.273345 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:25.274008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1f942c93-e3af-405d-9fdc-fa738df429f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:25.275592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 918/1832] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:25 2022] DELETE /identity/v3/projects/35afb726ebe5448a9794d1bd024c093c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:25.281132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf893d1-945c-406e-9ece-2873e16bee9d None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:25.281431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf893d1-945c-406e-9ece-2873e16bee9d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:25.281717 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf893d1-945c-406e-9ece-2873e16bee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:25.300213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-dcf893d1-945c-406e-9ece-2873e16bee9d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:25.302139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-dcf893d1-945c-406e-9ece-2873e16bee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:25.362888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 915/1833] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:25.371730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c973e4-426a-47e5-8e28-8b8442fc7b6f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:25.372038 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c973e4-426a-47e5-8e28-8b8442fc7b6f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:25.372320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c973e4-426a-47e5-8e28-8b8442fc7b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:25.394571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-65c973e4-426a-47e5-8e28-8b8442fc7b6f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:25.396126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-65c973e4-426a-47e5-8e28-8b8442fc7b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:25.404405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 919/1834] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:25.408832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf893d1-945c-406e-9ece-2873e16bee9d None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:25.419248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf893d1-945c-406e-9ece-2873e16bee9d None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:25.423865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62c387-edfd-4da2-8091-4ecac3fc5efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:25.424558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62c387-edfd-4da2-8091-4ecac3fc5efb admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:25.424839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62c387-edfd-4da2-8091-4ecac3fc5efb admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:25.425115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62c387-edfd-4da2-8091-4ecac3fc5efb admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:25.425860 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62c387-edfd-4da2-8091-4ecac3fc5efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:49:25.427077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62c387-edfd-4da2-8091-4ecac3fc5efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:25.428808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62c387-edfd-4da2-8091-4ecac3fc5efb admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:25.441342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 916/1835] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:49:25.446844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c973e4-426a-47e5-8e28-8b8442fc7b6f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:25.457023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c973e4-426a-47e5-8e28-8b8442fc7b6f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:25.462745 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37f508-4ef8-4556-b579-b64b179cfb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:25.463437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37f508-4ef8-4556-b579-b64b179cfb23 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:25.463983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37f508-4ef8-4556-b579-b64b179cfb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:25.464277 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37f508-4ef8-4556-b579-b64b179cfb23 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:25.464993 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37f508-4ef8-4556-b579-b64b179cfb23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:25.467140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37f508-4ef8-4556-b579-b64b179cfb23 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:25.495629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 920/1836] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:25 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:25.499938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62c387-edfd-4da2-8091-4ecac3fc5efb admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:25.510879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62c387-edfd-4da2-8091-4ecac3fc5efb admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:25.573429 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1160-3002-4e3f-88f0-b8da7ee16b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:25.574185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1160-3002-4e3f-88f0-b8da7ee16b28 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:25.574473 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1160-3002-4e3f-88f0-b8da7ee16b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:25.574755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1160-3002-4e3f-88f0-b8da7ee16b28 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:25.575497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1160-3002-4e3f-88f0-b8da7ee16b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:25.577551 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1160-3002-4e3f-88f0-b8da7ee16b28 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:25.602247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 917/1837] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:25 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:49:25.606536 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37f508-4ef8-4556-b579-b64b179cfb23 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:25.618149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37f508-4ef8-4556-b579-b64b179cfb23 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:25.623440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402501f-5e4e-4ca6-91cc-88f51a2bf909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:25.624284 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402501f-5e4e-4ca6-91cc-88f51a2bf909 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:25.624574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402501f-5e4e-4ca6-91cc-88f51a2bf909 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:25.624850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402501f-5e4e-4ca6-91cc-88f51a2bf909 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:25.625613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402501f-5e4e-4ca6-91cc-88f51a2bf909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:25.627540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402501f-5e4e-4ca6-91cc-88f51a2bf909 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:25.641069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 921/1838] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:25.643961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1160-3002-4e3f-88f0-b8da7ee16b28 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:25.654724 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1160-3002-4e3f-88f0-b8da7ee16b28 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:25.659607 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc798e-b938-47fc-8d5c-b68a6890a037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:25.661331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc798e-b938-47fc-8d5c-b68a6890a037 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:25.661645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc798e-b938-47fc-8d5c-b68a6890a037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:25.662079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc798e-b938-47fc-8d5c-b68a6890a037 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:25.662850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc798e-b938-47fc-8d5c-b68a6890a037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:25.664520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc798e-b938-47fc-8d5c-b68a6890a037 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:25.675897 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 918/1839] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:25.681448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402501f-5e4e-4ca6-91cc-88f51a2bf909 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:25.692369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402501f-5e4e-4ca6-91cc-88f51a2bf909 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:25.697899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d8603-4183-4ece-b7ff-12460d5d5c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:25.698994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d8603-4183-4ece-b7ff-12460d5d5c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:25.699375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d8603-4183-4ece-b7ff-12460d5d5c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:25.699890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d8603-4183-4ece-b7ff-12460d5d5c60 admin admin] PATH_INFO: `/v3/projects/2339b451d34d44b98bfac65bb65ac78a/users/ee0722dfa1264831913fef363dfe4235/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:25.726730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d8603-4183-4ece-b7ff-12460d5d5c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2339b451d34d44b98bfac65bb65ac78a, user_id=ee0722dfa1264831913fef363dfe4235, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:25.731091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d8603-4183-4ece-b7ff-12460d5d5c60 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:25.749563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 922/1840] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:25 2022] PUT /identity/v3/projects/2339b451d34d44b98bfac65bb65ac78a/users/ee0722dfa1264831913fef363dfe4235/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:25.762844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17352ea3-9a57-4ebc-a425-9fd6f0f0f4cd None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:25.763328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17352ea3-9a57-4ebc-a425-9fd6f0f0f4cd None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:25.763803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17352ea3-9a57-4ebc-a425-9fd6f0f0f4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:25.805267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-17352ea3-9a57-4ebc-a425-9fd6f0f0f4cd None None] MFA Rules not processed for user `ee0722dfa1264831913fef363dfe4235`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:25.807190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-17352ea3-9a57-4ebc-a425-9fd6f0f0f4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:25.887541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 919/1841] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:25.892469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d8603-4183-4ece-b7ff-12460d5d5c60 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:26.029003 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d8603-4183-4ece-b7ff-12460d5d5c60 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:26.038304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a3e4-e958-4e30-803f-edcd2d065c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:26.039373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a3e4-e958-4e30-803f-edcd2d065c85 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:26.039701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a3e4-e958-4e30-803f-edcd2d065c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:26.040061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a3e4-e958-4e30-803f-edcd2d065c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:26.041187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5a3e4-e958-4e30-803f-edcd2d065c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:26.043924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5a3e4-e958-4e30-803f-edcd2d065c85 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:26.095804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17352ea3-9a57-4ebc-a425-9fd6f0f0f4cd None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:26.104345 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 923/1842] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:25 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:26.114000 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17352ea3-9a57-4ebc-a425-9fd6f0f0f4cd None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:26.207164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d0f2b-02f8-4d5e-b737-2565d5bebe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:26.208623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d0f2b-02f8-4d5e-b737-2565d5bebe28 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:26.209241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d0f2b-02f8-4d5e-b737-2565d5bebe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:26.209829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d0f2b-02f8-4d5e-b737-2565d5bebe28 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:26.215000 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d0f2b-02f8-4d5e-b737-2565d5bebe28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:26.215449 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d0f2b-02f8-4d5e-b737-2565d5bebe28 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:26.251858 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 920/1843] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:26 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:26.258919 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a3e4-e958-4e30-803f-edcd2d065c85 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:26.279377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a3e4-e958-4e30-803f-edcd2d065c85 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:26.287470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51720c17-69ca-403d-b728-0c26d248d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:26.288684 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51720c17-69ca-403d-b728-0c26d248d58e admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:26.289168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51720c17-69ca-403d-b728-0c26d248d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:26.289646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51720c17-69ca-403d-b728-0c26d248d58e admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:26.290983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51720c17-69ca-403d-b728-0c26d248d58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:26.294042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51720c17-69ca-403d-b728-0c26d248d58e admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:26.309678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 924/1844] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:26.315154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d0f2b-02f8-4d5e-b737-2565d5bebe28 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:26.332967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d0f2b-02f8-4d5e-b737-2565d5bebe28 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:26.340591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16ddd0-c10f-4cae-9fab-be14406c9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:26.341713 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16ddd0-c10f-4cae-9fab-be14406c9986 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:26.342106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16ddd0-c10f-4cae-9fab-be14406c9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:26.342524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16ddd0-c10f-4cae-9fab-be14406c9986 admin admin] PATH_INFO: `/v3/projects/fb59993cbd0545db86757d4185663f69/users/73217f8e0f6840db9e57c6ef25378cec/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:26.364655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16ddd0-c10f-4cae-9fab-be14406c9986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb59993cbd0545db86757d4185663f69, user_id=73217f8e0f6840db9e57c6ef25378cec, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:26.367761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16ddd0-c10f-4cae-9fab-be14406c9986 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:26.387824 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 921/1845] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:26 2022] PUT /identity/v3/projects/fb59993cbd0545db86757d4185663f69/users/73217f8e0f6840db9e57c6ef25378cec/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:26.393431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51720c17-69ca-403d-b728-0c26d248d58e admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:26.406458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51720c17-69ca-403d-b728-0c26d248d58e admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:26.487588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42325cf0-6e8d-415a-a0af-88b7102e5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:26.487588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325cf0-6e8d-415a-a0af-88b7102e5c30 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:26.487588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325cf0-6e8d-415a-a0af-88b7102e5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:26.487588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325cf0-6e8d-415a-a0af-88b7102e5c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:26.488027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42325cf0-6e8d-415a-a0af-88b7102e5c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:26.490392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42325cf0-6e8d-415a-a0af-88b7102e5c30 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:26.501263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 925/1846] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:26.506190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16ddd0-c10f-4cae-9fab-be14406c9986 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:26.517550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16ddd0-c10f-4cae-9fab-be14406c9986 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:26.524536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5e8f4-9cd7-41fc-bb2c-df596ecbc1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:26.524977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5e8f4-9cd7-41fc-bb2c-df596ecbc1be admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:26.525268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5e8f4-9cd7-41fc-bb2c-df596ecbc1be admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:26.525547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5e8f4-9cd7-41fc-bb2c-df596ecbc1be admin admin] PATH_INFO: `/v3/projects/fb59993cbd0545db86757d4185663f69/users/73217f8e0f6840db9e57c6ef25378cec/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:26.527932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5e8f4-9cd7-41fc-bb2c-df596ecbc1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb59993cbd0545db86757d4185663f69, user_id=73217f8e0f6840db9e57c6ef25378cec, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:26.530607 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5e8f4-9cd7-41fc-bb2c-df596ecbc1be admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:26.550796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 922/1847] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:26 2022] PUT /identity/v3/projects/fb59993cbd0545db86757d4185663f69/users/73217f8e0f6840db9e57c6ef25378cec/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:26.556274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6095059-5cc4-447a-806b-c3d7c73d2ad7 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:26.556611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6095059-5cc4-447a-806b-c3d7c73d2ad7 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:26.557018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6095059-5cc4-447a-806b-c3d7c73d2ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:26.600730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c6095059-5cc4-447a-806b-c3d7c73d2ad7 None None] MFA Rules not processed for user `73217f8e0f6840db9e57c6ef25378cec`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:26.602187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c6095059-5cc4-447a-806b-c3d7c73d2ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:26.695114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 926/1848] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:26.706156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5e8f4-9cd7-41fc-bb2c-df596ecbc1be admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:26.708554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-57e5e8f4-9cd7-41fc-bb2c-df596ecbc1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:26.795513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5e8f4-9cd7-41fc-bb2c-df596ecbc1be admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:26.799890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081ce62-df60-4f5d-acee-803a9fd6945b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:26.801103 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081ce62-df60-4f5d-acee-803a9fd6945b service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:26.802064 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081ce62-df60-4f5d-acee-803a9fd6945b service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:26.802599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081ce62-df60-4f5d-acee-803a9fd6945b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:26.816442 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081ce62-df60-4f5d-acee-803a9fd6945b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:26.818731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081ce62-df60-4f5d-acee-803a9fd6945b service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:26.830006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 923/1849] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:26.939427 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6095059-5cc4-447a-806b-c3d7c73d2ad7 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:26.951989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6095059-5cc4-447a-806b-c3d7c73d2ad7 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:26.958946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c30924-4265-4553-b80e-2337d74091b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:26.959384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30924-4265-4553-b80e-2337d74091b3 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:26.959842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30924-4265-4553-b80e-2337d74091b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:26.960223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30924-4265-4553-b80e-2337d74091b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:27.036915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c30924-4265-4553-b80e-2337d74091b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:27.038582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c30924-4265-4553-b80e-2337d74091b3 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:27.052146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 927/1850] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:27.701314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081ce62-df60-4f5d-acee-803a9fd6945b service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:27.704944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a081ce62-df60-4f5d-acee-803a9fd6945b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:27.839042 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081ce62-df60-4f5d-acee-803a9fd6945b service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:27.852148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:27.860116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:27.860453 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:27.860849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] PATH_INFO: `/v3/users/b5537202a7d84766a8f7ba60b478cffd` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:27.862581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5537202a7d84766a8f7ba60b478cffd)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:27.873411 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:27.941084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5537202a7d84766a8f7ba60b478cffd'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:27.966917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5537202a7d84766a8f7ba60b478cffd'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:27.967696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5537202a7d84766a8f7ba60b478cffd'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:27.968232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5537202a7d84766a8f7ba60b478cffd'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:27.981972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5537202a7d84766a8f7ba60b478cffd'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:28.005415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 924/1851] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:27 2022] DELETE /identity/v3/users/b5537202a7d84766a8f7ba60b478cffd => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:28.009366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c9b8c-0677-4b52-8994-4f51dca86c9b None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:28.009849 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c9b8c-0677-4b52-8994-4f51dca86c9b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:28.009979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c9b8c-0677-4b52-8994-4f51dca86c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:28.030055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-9c9c9b8c-0677-4b52-8994-4f51dca86c9b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:28.031542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9c9c9b8c-0677-4b52-8994-4f51dca86c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:28.104635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 928/1852] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:28.118959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:28.120540 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:28.197086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bb1ac-5604-4839-a02f-406945034567 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:28.202956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86f4eb-2d21-4215-b559-540de6af8f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:28.203636 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f4eb-2d21-4215-b559-540de6af8f55 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:28.203965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f4eb-2d21-4215-b559-540de6af8f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:28.204248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f4eb-2d21-4215-b559-540de6af8f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:28.218856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86f4eb-2d21-4215-b559-540de6af8f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:28.220529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86f4eb-2d21-4215-b559-540de6af8f55 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:28.243793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 925/1853] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:28.520626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c9b8c-0677-4b52-8994-4f51dca86c9b None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:28.522150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9c9c9b8c-0677-4b52-8994-4f51dca86c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:28.534965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c9b8c-0677-4b52-8994-4f51dca86c9b None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:28.540998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:28.542180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:28.542455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:28.543079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] PATH_INFO: `/v3/projects/a6ac631b8cb64af8bfcb977130dcea49` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:28.544466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ac631b8cb64af8bfcb977130dcea49)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:28.546244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:28.626490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ac631b8cb64af8bfcb977130dcea49', 'request_id': 'req-346b920a-578b-46d1-bb66-642cc82d395e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:28.634146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ac631b8cb64af8bfcb977130dcea49', 'request_id': 'req-346b920a-578b-46d1-bb66-642cc82d395e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:28.643270 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ac631b8cb64af8bfcb977130dcea49', 'request_id': 'req-346b920a-578b-46d1-bb66-642cc82d395e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:28.654493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] The token cache is being invalidate because project a6ac631b8cb64af8bfcb977130dcea49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:28.654814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:28.655435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:28.657027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 929/1854] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:28 2022] DELETE /identity/v3/projects/a6ac631b8cb64af8bfcb977130dcea49 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:28.661500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86f4eb-2d21-4215-b559-540de6af8f55 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:28.671060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86f4eb-2d21-4215-b559-540de6af8f55 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:28.735687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:28.736867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:28.737287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:28.737668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] PATH_INFO: `/v3/users/0d9fa9c38e3e41bd9bda525e2025b262` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:28.739392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9fa9c38e3e41bd9bda525e2025b262)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:28.741521 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:28.794657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9fa9c38e3e41bd9bda525e2025b262'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:28.809113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9fa9c38e3e41bd9bda525e2025b262'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:28.809859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9fa9c38e3e41bd9bda525e2025b262'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:28.810478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9fa9c38e3e41bd9bda525e2025b262'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:28.820999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9fa9c38e3e41bd9bda525e2025b262'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:28.838312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 926/1855] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:28 2022] DELETE /identity/v3/users/0d9fa9c38e3e41bd9bda525e2025b262 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:29.240860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:29.242682 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:29.256746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b920a-578b-46d1-bb66-642cc82d395e admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:29.336646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:29.337693 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:29.337977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:29.338393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] PATH_INFO: `/v3/projects/1020cefba3cb4b0b845963b306943fcf` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:29.339923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=1020cefba3cb4b0b845963b306943fcf)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:29.341837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:29.377017 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:29.378578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:29.391827 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b3276-b006-414c-a245-4b1321434c08 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:29.398452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1020cefba3cb4b0b845963b306943fcf', 'request_id': 'req-c5d836d6-8793-457c-bf29-a77988bcb7be'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.405224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1020cefba3cb4b0b845963b306943fcf', 'request_id': 'req-c5d836d6-8793-457c-bf29-a77988bcb7be'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.413125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1020cefba3cb4b0b845963b306943fcf', 'request_id': 'req-c5d836d6-8793-457c-bf29-a77988bcb7be'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.424063 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] The token cache is being invalidate because project 1020cefba3cb4b0b845963b306943fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:29.424416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.425043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.426803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 930/1856] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:29 2022] DELETE /identity/v3/projects/1020cefba3cb4b0b845963b306943fcf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:29.430730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:29.432094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:29.452901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2007f-0deb-46a3-91ed-46e938ddc527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:29.453787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2007f-0deb-46a3-91ed-46e938ddc527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:29.454068 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2007f-0deb-46a3-91ed-46e938ddc527 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:29.454344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2007f-0deb-46a3-91ed-46e938ddc527 admin admin] PATH_INFO: `/v3/users/ee0722dfa1264831913fef363dfe4235` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:29.455614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2007f-0deb-46a3-91ed-46e938ddc527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0722dfa1264831913fef363dfe4235)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:29.458207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2007f-0deb-46a3-91ed-46e938ddc527 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:29.498192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d836d6-8793-457c-bf29-a77988bcb7be admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:29.503054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:29.503982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:29.504757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:29.505034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] PATH_INFO: `/v3/users/ae00b79bd6574a69803310780e55a12b` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:29.506263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae00b79bd6574a69803310780e55a12b)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:29.506973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5fd2007f-0deb-46a3-91ed-46e938ddc527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0722dfa1264831913fef363dfe4235'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.508292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:29.519531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5fd2007f-0deb-46a3-91ed-46e938ddc527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0722dfa1264831913fef363dfe4235'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.520621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5fd2007f-0deb-46a3-91ed-46e938ddc527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0722dfa1264831913fef363dfe4235'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.521241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5fd2007f-0deb-46a3-91ed-46e938ddc527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0722dfa1264831913fef363dfe4235'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.528874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5fd2007f-0deb-46a3-91ed-46e938ddc527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0722dfa1264831913fef363dfe4235'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.543790 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 927/1857] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:29 2022] DELETE /identity/v3/users/ee0722dfa1264831913fef363dfe4235 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:29.548241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e06d6-b5c8-436d-92e9-6a565b7f3090 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:29.548539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e06d6-b5c8-436d-92e9-6a565b7f3090 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:29.548866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e06d6-b5c8-436d-92e9-6a565b7f3090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:29.558603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae00b79bd6574a69803310780e55a12b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.567585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-c69e06d6-b5c8-436d-92e9-6a565b7f3090 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:29.568426 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c69e06d6-b5c8-436d-92e9-6a565b7f3090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:29.572399 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae00b79bd6574a69803310780e55a12b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.573152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae00b79bd6574a69803310780e55a12b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.581256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae00b79bd6574a69803310780e55a12b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.589180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae00b79bd6574a69803310780e55a12b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:29.595387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 931/1858] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:29 2022] DELETE /identity/v3/users/ae00b79bd6574a69803310780e55a12b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:29.630282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 928/1859] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:29.640132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:29.641870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:29.704030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba48d-253b-40ab-8b66-3ce30b59aff7 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:29.708389 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a078d92-8115-4eed-8a80-db0a2fe8332d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:29.709052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078d92-8115-4eed-8a80-db0a2fe8332d service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:29.709334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078d92-8115-4eed-8a80-db0a2fe8332d service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:29.709610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078d92-8115-4eed-8a80-db0a2fe8332d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:29.787256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a078d92-8115-4eed-8a80-db0a2fe8332d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:29.789160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a078d92-8115-4eed-8a80-db0a2fe8332d service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:29.805691 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 932/1860] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:29.972786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e06d6-b5c8-436d-92e9-6a565b7f3090 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:29.974707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c69e06d6-b5c8-436d-92e9-6a565b7f3090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:29.989784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e06d6-b5c8-436d-92e9-6a565b7f3090 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:29.995209 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:29.996096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:29.996544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:29.997184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] PATH_INFO: `/v3/projects/1d1278a5796449969535df5c5e5edb08` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:29.999246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1278a5796449969535df5c5e5edb08)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:30.001657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:30.070929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1278a5796449969535df5c5e5edb08', 'request_id': 'req-096d901f-1ecf-4582-becd-74bdc5e647db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.078501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1278a5796449969535df5c5e5edb08', 'request_id': 'req-096d901f-1ecf-4582-becd-74bdc5e647db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.087820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1278a5796449969535df5c5e5edb08', 'request_id': 'req-096d901f-1ecf-4582-becd-74bdc5e647db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.099174 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] The token cache is being invalidate because project 1d1278a5796449969535df5c5e5edb08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:30.099528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.100254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-096d901f-1ecf-4582-becd-74bdc5e647db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.102052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 929/1861] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:29 2022] DELETE /identity/v3/projects/1d1278a5796449969535df5c5e5edb08 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:30.108933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6179-da31-4844-b347-276aa2a0d84d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:30.109159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6179-da31-4844-b347-276aa2a0d84d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:30.109635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6179-da31-4844-b347-276aa2a0d84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:30.134110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-332e6179-da31-4844-b347-276aa2a0d84d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:30.135486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-332e6179-da31-4844-b347-276aa2a0d84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:30.221508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 933/1862] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:30.232110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacfffe-fca6-4536-9951-7a23ea82f453 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:30.232478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacfffe-fca6-4536-9951-7a23ea82f453 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:30.232834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacfffe-fca6-4536-9951-7a23ea82f453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:30.237957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e6179-da31-4844-b347-276aa2a0d84d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:30.242081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-332e6179-da31-4844-b347-276aa2a0d84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:30.260160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e6179-da31-4844-b347-276aa2a0d84d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:30.267764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:30.268967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:30.269535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:30.270553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] PATH_INFO: `/v3/projects/2339b451d34d44b98bfac65bb65ac78a` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:30.272460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] RBAC: Authorizing `identity:delete_project(project_id=2339b451d34d44b98bfac65bb65ac78a)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:30.276309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:30.277036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-adacfffe-fca6-4536-9951-7a23ea82f453 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:30.278276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-adacfffe-fca6-4536-9951-7a23ea82f453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:30.289838 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 930/1863] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:30.296382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacfffe-fca6-4536-9951-7a23ea82f453 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:30.319742 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacfffe-fca6-4536-9951-7a23ea82f453 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:30.324978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0b488-c74f-40ce-b0b9-516f61471955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:30.325881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0b488-c74f-40ce-b0b9-516f61471955 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:30.326319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0b488-c74f-40ce-b0b9-516f61471955 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:30.326776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0b488-c74f-40ce-b0b9-516f61471955 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:30.327677 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0b488-c74f-40ce-b0b9-516f61471955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:49:30.329217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0b488-c74f-40ce-b0b9-516f61471955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:30.331040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0b488-c74f-40ce-b0b9-516f61471955 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:30.350791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2339b451d34d44b98bfac65bb65ac78a', 'request_id': 'req-4dd468f6-ea39-401f-aeac-451e9a8e23be'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.351614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 931/1864] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:49:30.357287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0b488-c74f-40ce-b0b9-516f61471955 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:30.358121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2339b451d34d44b98bfac65bb65ac78a', 'request_id': 'req-4dd468f6-ea39-401f-aeac-451e9a8e23be'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.368073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2339b451d34d44b98bfac65bb65ac78a', 'request_id': 'req-4dd468f6-ea39-401f-aeac-451e9a8e23be'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.374556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0b488-c74f-40ce-b0b9-516f61471955 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:30.394025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] The token cache is being invalidate because project 2339b451d34d44b98bfac65bb65ac78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:30.394520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.396305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.397519 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 934/1865] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:30 2022] DELETE /identity/v3/projects/2339b451d34d44b98bfac65bb65ac78a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:30.401532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:30.402883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:30.437507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87d193-cf52-4df7-a232-98a98ae68116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:30.438277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d193-cf52-4df7-a232-98a98ae68116 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:30.438638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d193-cf52-4df7-a232-98a98ae68116 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:30.439017 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d193-cf52-4df7-a232-98a98ae68116 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:30.439814 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87d193-cf52-4df7-a232-98a98ae68116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:30.442537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87d193-cf52-4df7-a232-98a98ae68116 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:30.468687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd468f6-ea39-401f-aeac-451e9a8e23be admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:30.469996 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 932/1866] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:30 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:49:30.474416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87d193-cf52-4df7-a232-98a98ae68116 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:30.476065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ac87d193-cf52-4df7-a232-98a98ae68116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:30.525231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:30.526020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:30.526308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:30.526581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] PATH_INFO: `/v3/users/73217f8e0f6840db9e57c6ef25378cec` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:30.527838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73217f8e0f6840db9e57c6ef25378cec)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:30.529757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:30.539927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87d193-cf52-4df7-a232-98a98ae68116 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:30.544609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8e522-c5ff-433d-b314-77ff9533c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:30.545287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8e522-c5ff-433d-b314-77ff9533c578 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:30.545569 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8e522-c5ff-433d-b314-77ff9533c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:30.545846 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8e522-c5ff-433d-b314-77ff9533c578 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:30.546559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8e522-c5ff-433d-b314-77ff9533c578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:30.548549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8e522-c5ff-433d-b314-77ff9533c578 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:30.574259 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 933/1867] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:30 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:49:30.575339 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8e522-c5ff-433d-b314-77ff9533c578 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:30.579342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73217f8e0f6840db9e57c6ef25378cec'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.586022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8e522-c5ff-433d-b314-77ff9533c578 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:30.591271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c3ec8-93a4-4a6d-a589-5bc3ac699efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:30.591986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c3ec8-93a4-4a6d-a589-5bc3ac699efd admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:30.592418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c3ec8-93a4-4a6d-a589-5bc3ac699efd admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:30.592542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73217f8e0f6840db9e57c6ef25378cec'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.592705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c3ec8-93a4-4a6d-a589-5bc3ac699efd admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:30.593274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73217f8e0f6840db9e57c6ef25378cec'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.593488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c3ec8-93a4-4a6d-a589-5bc3ac699efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:30.595099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c3ec8-93a4-4a6d-a589-5bc3ac699efd admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:30.600942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73217f8e0f6840db9e57c6ef25378cec'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.607571 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 934/1868] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:30.608339 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73217f8e0f6840db9e57c6ef25378cec'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:30.611695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c3ec8-93a4-4a6d-a589-5bc3ac699efd admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:30.614106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ec5c3ec8-93a4-4a6d-a589-5bc3ac699efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:30.615139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 935/1869] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:30 2022] DELETE /identity/v3/users/73217f8e0f6840db9e57c6ef25378cec => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:30.627032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c3ec8-93a4-4a6d-a589-5bc3ac699efd admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:30.689745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1aa3e-6767-485b-8ccf-e0f9dc3a396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:30.690438 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1aa3e-6767-485b-8ccf-e0f9dc3a396b admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:30.690719 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1aa3e-6767-485b-8ccf-e0f9dc3a396b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:30.690994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1aa3e-6767-485b-8ccf-e0f9dc3a396b admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:30.691985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1aa3e-6767-485b-8ccf-e0f9dc3a396b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:30.693743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1aa3e-6767-485b-8ccf-e0f9dc3a396b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:30.711641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 935/1870] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:49:30.713052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:30.728221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55250773-b775-41fe-97e5-9c300b243f1d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:30.737322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06598560-d063-4fe2-afe4-615e1fdd2e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:30.740442 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06598560-d063-4fe2-afe4-615e1fdd2e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:30.741207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06598560-d063-4fe2-afe4-615e1fdd2e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:30.741727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06598560-d063-4fe2-afe4-615e1fdd2e36 admin admin] PATH_INFO: `/v3/projects/0ab03ce8d9a740269523499f1c92501d/users/d7b207bf0e0e4d1cb01d4fee0a9fb8db/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:30.783910 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06598560-d063-4fe2-afe4-615e1fdd2e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab03ce8d9a740269523499f1c92501d, user_id=d7b207bf0e0e4d1cb01d4fee0a9fb8db, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:30.788990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06598560-d063-4fe2-afe4-615e1fdd2e36 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:30.824691 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 936/1871] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:30 2022] PUT /identity/v3/projects/0ab03ce8d9a740269523499f1c92501d/users/d7b207bf0e0e4d1cb01d4fee0a9fb8db/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:30.834476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac305d-e47a-407c-906b-1634ca989bfc None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:30.834777 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac305d-e47a-407c-906b-1634ca989bfc None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:30.836315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac305d-e47a-407c-906b-1634ca989bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:30.889546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-2bac305d-e47a-407c-906b-1634ca989bfc None None] MFA Rules not processed for user `d7b207bf0e0e4d1cb01d4fee0a9fb8db`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:30.891049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2bac305d-e47a-407c-906b-1634ca989bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:31.009881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 936/1872] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:31.020734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06598560-d063-4fe2-afe4-615e1fdd2e36 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:31.146631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06598560-d063-4fe2-afe4-615e1fdd2e36 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:31.154739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60cb04-fd25-434e-9315-bbe147bd52ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:31.156131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60cb04-fd25-434e-9315-bbe147bd52ee admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:31.156687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60cb04-fd25-434e-9315-bbe147bd52ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:31.157139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60cb04-fd25-434e-9315-bbe147bd52ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:31.158924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60cb04-fd25-434e-9315-bbe147bd52ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:31.161388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60cb04-fd25-434e-9315-bbe147bd52ee admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:31.210722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 937/1873] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:31 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:49:31.216515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac305d-e47a-407c-906b-1634ca989bfc None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:31.244601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac305d-e47a-407c-906b-1634ca989bfc None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:31.420649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a546c-4c42-490d-9929-5ce740034cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:31.422065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a546c-4c42-490d-9929-5ce740034cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:31.422740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a546c-4c42-490d-9929-5ce740034cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:31.423448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a546c-4c42-490d-9929-5ce740034cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:31.424738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a546c-4c42-490d-9929-5ce740034cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:31.430584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a546c-4c42-490d-9929-5ce740034cd7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:31.475491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 937/1874] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:31 2022] POST /identity/v3/users => generated 300 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:31.480805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60cb04-fd25-434e-9315-bbe147bd52ee admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:31.498628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60cb04-fd25-434e-9315-bbe147bd52ee admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:31.514865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14496b-6fd7-4e46-9710-fff663e78144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:31.515578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14496b-6fd7-4e46-9710-fff663e78144 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:31.515901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14496b-6fd7-4e46-9710-fff663e78144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:31.516186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14496b-6fd7-4e46-9710-fff663e78144 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:31.516945 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14496b-6fd7-4e46-9710-fff663e78144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:31.518586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14496b-6fd7-4e46-9710-fff663e78144 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:31.554064 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 938/1875] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:31.558926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a546c-4c42-490d-9929-5ce740034cd7 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:31.571612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a546c-4c42-490d-9929-5ce740034cd7 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:31.581753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323451a-e150-49f0-8a01-78449f97486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:31.585154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323451a-e150-49f0-8a01-78449f97486e admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:31.585658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323451a-e150-49f0-8a01-78449f97486e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:31.586352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323451a-e150-49f0-8a01-78449f97486e admin admin] PATH_INFO: `/v3/projects/b751faf45e2c45308b4442fc2000ccd1/users/27323cb63be547d18d91b70fed894786/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:31.624923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323451a-e150-49f0-8a01-78449f97486e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b751faf45e2c45308b4442fc2000ccd1, user_id=27323cb63be547d18d91b70fed894786, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:31.633915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323451a-e150-49f0-8a01-78449f97486e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:31.668740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 938/1876] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:31 2022] PUT /identity/v3/projects/b751faf45e2c45308b4442fc2000ccd1/users/27323cb63be547d18d91b70fed894786/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:31.673592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14496b-6fd7-4e46-9710-fff663e78144 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:31.698264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14496b-6fd7-4e46-9710-fff663e78144 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:31.810230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cd9c5-08bc-49c1-97f3-15361d261bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:31.811156 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cd9c5-08bc-49c1-97f3-15361d261bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:31.811513 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cd9c5-08bc-49c1-97f3-15361d261bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:31.812308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cd9c5-08bc-49c1-97f3-15361d261bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:31.813124 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cd9c5-08bc-49c1-97f3-15361d261bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:31.820525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cd9c5-08bc-49c1-97f3-15361d261bf7 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:31.840986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 939/1877] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:31.846911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323451a-e150-49f0-8a01-78449f97486e admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:31.859398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323451a-e150-49f0-8a01-78449f97486e admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:31.869310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63517a-ff22-4aee-a139-3c61bd5f0783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:31.871611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63517a-ff22-4aee-a139-3c61bd5f0783 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:31.872002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63517a-ff22-4aee-a139-3c61bd5f0783 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:31.872475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63517a-ff22-4aee-a139-3c61bd5f0783 admin admin] PATH_INFO: `/v3/projects/b751faf45e2c45308b4442fc2000ccd1/users/27323cb63be547d18d91b70fed894786/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:31.875658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63517a-ff22-4aee-a139-3c61bd5f0783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b751faf45e2c45308b4442fc2000ccd1, user_id=27323cb63be547d18d91b70fed894786, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:31.882011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63517a-ff22-4aee-a139-3c61bd5f0783 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:31.899418 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cd9c5-08bc-49c1-97f3-15361d261bf7 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:31.902237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-821cd9c5-08bc-49c1-97f3-15361d261bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:31.905269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 939/1878] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:31 2022] PUT /identity/v3/projects/b751faf45e2c45308b4442fc2000ccd1/users/27323cb63be547d18d91b70fed894786/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:31.917260 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f87f-5100-4777-a877-5f5632b708c3 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:31.918015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f87f-5100-4777-a877-5f5632b708c3 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:31.918617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f87f-5100-4777-a877-5f5632b708c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:31.932129 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cd9c5-08bc-49c1-97f3-15361d261bf7 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:32.000869 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4d34f87f-5100-4777-a877-5f5632b708c3 None None] MFA Rules not processed for user `27323cb63be547d18d91b70fed894786`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:32.000869 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4d34f87f-5100-4777-a877-5f5632b708c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:32.053446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:32.054337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:32.054749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:32.054907 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] PATH_INFO: `/v3/projects/fb59993cbd0545db86757d4185663f69` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:32.056392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb59993cbd0545db86757d4185663f69)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:32.058316 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:32.140263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 940/1879] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:32.150522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34f87f-5100-4777-a877-5f5632b708c3 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:32.152620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4d34f87f-5100-4777-a877-5f5632b708c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:32.175756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb59993cbd0545db86757d4185663f69', 'request_id': 'req-e5ead799-7371-4295-9bf8-e284c89f347c'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:32.189960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb59993cbd0545db86757d4185663f69', 'request_id': 'req-e5ead799-7371-4295-9bf8-e284c89f347c'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:32.203034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb59993cbd0545db86757d4185663f69', 'request_id': 'req-e5ead799-7371-4295-9bf8-e284c89f347c'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:32.235985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] The token cache is being invalidate because project fb59993cbd0545db86757d4185663f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:32.235985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:32.236736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e5ead799-7371-4295-9bf8-e284c89f347c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:32.240395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 940/1880] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:31 2022] DELETE /identity/v3/projects/fb59993cbd0545db86757d4185663f69 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:32.241908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34f87f-5100-4777-a877-5f5632b708c3 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:32.248457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcb038-e65d-4bb6-80c3-d2c727117b93 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:32.248900 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcb038-e65d-4bb6-80c3-d2c727117b93 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:32.249328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcb038-e65d-4bb6-80c3-d2c727117b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:32.280560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-21bcb038-e65d-4bb6-80c3-d2c727117b93 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:32.282564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-21bcb038-e65d-4bb6-80c3-d2c727117b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:32.352058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1cfc4-c2df-4897-9c1c-e470660538d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:32.352782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cfc4-c2df-4897-9c1c-e470660538d7 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:32.353160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cfc4-c2df-4897-9c1c-e470660538d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:32.353621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cfc4-c2df-4897-9c1c-e470660538d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:32.356574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f2c1cfc4-c2df-4897-9c1c-e470660538d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:32.386960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 941/1881] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:32.408525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fe7b0-c431-4a98-9066-b04297e5ef92 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:32.408939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fe7b0-c431-4a98-9066-b04297e5ef92 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:32.409239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fe7b0-c431-4a98-9066-b04297e5ef92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:32.461419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-1b0fe7b0-c431-4a98-9066-b04297e5ef92 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:32.465451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1b0fe7b0-c431-4a98-9066-b04297e5ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:32.488784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 942/1882] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:32.491109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fe7b0-c431-4a98-9066-b04297e5ef92 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:32.511245 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fe7b0-c431-4a98-9066-b04297e5ef92 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:32.525237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9537f-edbf-4fb1-bf19-756595c4ddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:32.526098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9537f-edbf-4fb1-bf19-756595c4ddfb admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:32.526447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9537f-edbf-4fb1-bf19-756595c4ddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:32.526661 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9537f-edbf-4fb1-bf19-756595c4ddfb admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:32.527565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9537f-edbf-4fb1-bf19-756595c4ddfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:49:32.527900 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9537f-edbf-4fb1-bf19-756595c4ddfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:32.529591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9537f-edbf-4fb1-bf19-756595c4ddfb admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:32.553915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1cfc4-c2df-4897-9c1c-e470660538d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:32.556268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1cfc4-c2df-4897-9c1c-e470660538d7 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:32.559106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 943/1883] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:49:32.565438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9537f-edbf-4fb1-bf19-756595c4ddfb admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:32.573340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 941/1884] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:32.585979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9537f-edbf-4fb1-bf19-756595c4ddfb admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:32.592567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b9a60-b6f5-4b58-a2cd-0d44db24b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:32.593350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b9a60-b6f5-4b58-a2cd-0d44db24b63a admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:32.593712 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b9a60-b6f5-4b58-a2cd-0d44db24b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:32.594005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b9a60-b6f5-4b58-a2cd-0d44db24b63a admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:32.594868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b9a60-b6f5-4b58-a2cd-0d44db24b63a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:32.598505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b9a60-b6f5-4b58-a2cd-0d44db24b63a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:32.646909 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 944/1885] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:32 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:32.648696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1cfc4-c2df-4897-9c1c-e470660538d7 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:32.664967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1cfc4-c2df-4897-9c1c-e470660538d7 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:32.768237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c4cd4-bc59-4926-ba33-24ce25c208f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:32.769035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c4cd4-bc59-4926-ba33-24ce25c208f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:32.770038 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c4cd4-bc59-4926-ba33-24ce25c208f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:32.770911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c4cd4-bc59-4926-ba33-24ce25c208f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:32.771237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c4cd4-bc59-4926-ba33-24ce25c208f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:32.773613 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c4cd4-bc59-4926-ba33-24ce25c208f2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:32.807282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 942/1886] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:32 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:32.812431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b9a60-b6f5-4b58-a2cd-0d44db24b63a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:32.830410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b9a60-b6f5-4b58-a2cd-0d44db24b63a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:32.851201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c4cd4-bc59-4926-ba33-24ce25c208f2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:32.854020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387dd58-5578-4918-b7d6-5d28dcb8dc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:32.854420 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5c8c4cd4-bc59-4926-ba33-24ce25c208f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:32.855115 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387dd58-5578-4918-b7d6-5d28dcb8dc45 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:32.856109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387dd58-5578-4918-b7d6-5d28dcb8dc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:32.856529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387dd58-5578-4918-b7d6-5d28dcb8dc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:32.857721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387dd58-5578-4918-b7d6-5d28dcb8dc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:32.859528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387dd58-5578-4918-b7d6-5d28dcb8dc45 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:32.872207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 945/1887] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:32.873300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c4cd4-bc59-4926-ba33-24ce25c208f2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:32.881169 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387dd58-5578-4918-b7d6-5d28dcb8dc45 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:32.884463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f47306-a4a8-4e61-b65a-5eb488b29f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:32.885410 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47306-a4a8-4e61-b65a-5eb488b29f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:32.885410 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47306-a4a8-4e61-b65a-5eb488b29f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:32.885622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47306-a4a8-4e61-b65a-5eb488b29f70 admin admin] PATH_INFO: `/v3/users/e22dd1797db14656880c17d7e810a0a9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:32.887071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f47306-a4a8-4e61-b65a-5eb488b29f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22dd1797db14656880c17d7e810a0a9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:32.890363 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f47306-a4a8-4e61-b65a-5eb488b29f70 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:32.906477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387dd58-5578-4918-b7d6-5d28dcb8dc45 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:32.920818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644aabcf-88fb-41e2-bb35-88c4643ea3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:32.921524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aabcf-88fb-41e2-bb35-88c4643ea3cb admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:32.921805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aabcf-88fb-41e2-bb35-88c4643ea3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:32.922082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aabcf-88fb-41e2-bb35-88c4643ea3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:32.922832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aabcf-88fb-41e2-bb35-88c4643ea3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:32.924774 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aabcf-88fb-41e2-bb35-88c4643ea3cb admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:32.991882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 946/1888] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:32.998775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-83f47306-a4a8-4e61-b65a-5eb488b29f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22dd1797db14656880c17d7e810a0a9'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:32.999037 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644aabcf-88fb-41e2-bb35-88c4643ea3cb admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:33.015882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-83f47306-a4a8-4e61-b65a-5eb488b29f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22dd1797db14656880c17d7e810a0a9'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:33.016788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-83f47306-a4a8-4e61-b65a-5eb488b29f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22dd1797db14656880c17d7e810a0a9'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:33.017701 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-83f47306-a4a8-4e61-b65a-5eb488b29f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22dd1797db14656880c17d7e810a0a9'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:33.032190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-83f47306-a4a8-4e61-b65a-5eb488b29f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22dd1797db14656880c17d7e810a0a9'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:33.039994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644aabcf-88fb-41e2-bb35-88c4643ea3cb admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:33.061908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 943/1889] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:32 2022] DELETE /identity/v3/users/e22dd1797db14656880c17d7e810a0a9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:33.069214 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398e22b-2d63-4a09-bba8-999492187b82 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:33.069823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398e22b-2d63-4a09-bba8-999492187b82 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:33.070369 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398e22b-2d63-4a09-bba8-999492187b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:33.072423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27bdf6-ec8d-4547-a025-feb392f840e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:33.079566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27bdf6-ec8d-4547-a025-feb392f840e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:33.080235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27bdf6-ec8d-4547-a025-feb392f840e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:33.082155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27bdf6-ec8d-4547-a025-feb392f840e8 admin admin] PATH_INFO: `/v3/projects/724cd36d04304add9a366367045a320d/users/5f2db4aeccd941d0b393e69d57e4e084/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:33.123531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27bdf6-ec8d-4547-a025-feb392f840e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724cd36d04304add9a366367045a320d, user_id=5f2db4aeccd941d0b393e69d57e4e084, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:33.129964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27bdf6-ec8d-4547-a025-feb392f840e8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:33.131757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-9398e22b-2d63-4a09-bba8-999492187b82 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:33.134587 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9398e22b-2d63-4a09-bba8-999492187b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:33.149291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 947/1890] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:32 2022] PUT /identity/v3/projects/724cd36d04304add9a366367045a320d/users/5f2db4aeccd941d0b393e69d57e4e084/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:33.150409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27bdf6-ec8d-4547-a025-feb392f840e8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:33.154139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-af27bdf6-ec8d-4547-a025-feb392f840e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:33.281313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27bdf6-ec8d-4547-a025-feb392f840e8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:33.286113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 944/1891] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:33.288643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376f37-be3c-4c8a-936a-5cb98c546d6b None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:33.289025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376f37-be3c-4c8a-936a-5cb98c546d6b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:33.289416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376f37-be3c-4c8a-936a-5cb98c546d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:33.296731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:33.298647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:33.299172 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:33.299845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] PATH_INFO: `/v3/users/d7b207bf0e0e4d1cb01d4fee0a9fb8db` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:33.303526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b207bf0e0e4d1cb01d4fee0a9fb8db)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:33.307466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:33.347469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1d376f37-be3c-4c8a-936a-5cb98c546d6b None None] MFA Rules not processed for user `5f2db4aeccd941d0b393e69d57e4e084`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:33.358809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1d376f37-be3c-4c8a-936a-5cb98c546d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:33.454505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b207bf0e0e4d1cb01d4fee0a9fb8db'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:33.470098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b207bf0e0e4d1cb01d4fee0a9fb8db'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:33.470846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b207bf0e0e4d1cb01d4fee0a9fb8db'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:33.493377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b207bf0e0e4d1cb01d4fee0a9fb8db'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:33.496758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 945/1892] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:33.500202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d376f37-be3c-4c8a-936a-5cb98c546d6b None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:33.501936 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1d376f37-be3c-4c8a-936a-5cb98c546d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:33.505965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b207bf0e0e4d1cb01d4fee0a9fb8db'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:33.513623 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 948/1893] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:33 2022] DELETE /identity/v3/users/d7b207bf0e0e4d1cb01d4fee0a9fb8db => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:33.514642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:33.516695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:33.602355 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f66d1d-f0b2-4f9e-8235-eaf7925bcf7b admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:33.607169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d376f37-be3c-4c8a-936a-5cb98c546d6b None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:33.608455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf6714-7060-4407-bf1d-d63d036ece3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:33.609212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf6714-7060-4407-bf1d-d63d036ece3e admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:33.609528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf6714-7060-4407-bf1d-d63d036ece3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:33.609828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf6714-7060-4407-bf1d-d63d036ece3e admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:33.610557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf6714-7060-4407-bf1d-d63d036ece3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:33.612674 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf6714-7060-4407-bf1d-d63d036ece3e admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:33.647776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 949/1894] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:33 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:33.649642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a2d7-e7ed-4dac-aac9-4c1623a374c9 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:33.650212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a2d7-e7ed-4dac-aac9-4c1623a374c9 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:33.650441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a2d7-e7ed-4dac-aac9-4c1623a374c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:33.671185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-b731a2d7-e7ed-4dac-aac9-4c1623a374c9 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:33.672460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b731a2d7-e7ed-4dac-aac9-4c1623a374c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:33.679750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae87d14-ed38-457f-a3b8-36400662e6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:33.680421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae87d14-ed38-457f-a3b8-36400662e6ae service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:33.680702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae87d14-ed38-457f-a3b8-36400662e6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:33.680977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae87d14-ed38-457f-a3b8-36400662e6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:33.682843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7ae87d14-ed38-457f-a3b8-36400662e6ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:33.696394 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae87d14-ed38-457f-a3b8-36400662e6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:33.698045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae87d14-ed38-457f-a3b8-36400662e6ae service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:33.710529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 946/1895] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:33.711101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae87d14-ed38-457f-a3b8-36400662e6ae service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:33.722457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae87d14-ed38-457f-a3b8-36400662e6ae service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:33.763076 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 950/1896] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:33.781556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731a2d7-e7ed-4dac-aac9-4c1623a374c9 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:33.785978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b731a2d7-e7ed-4dac-aac9-4c1623a374c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:33.840540 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ed496-286d-4577-8bf7-c1d4315a1294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:33.841881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed496-286d-4577-8bf7-c1d4315a1294 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:33.842606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed496-286d-4577-8bf7-c1d4315a1294 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:33.843366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed496-286d-4577-8bf7-c1d4315a1294 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:33.845077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ed496-286d-4577-8bf7-c1d4315a1294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:33.847538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ed496-286d-4577-8bf7-c1d4315a1294 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:33.877165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 947/1897] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:33 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:33.883365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ed496-286d-4577-8bf7-c1d4315a1294 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:33.900225 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ed496-286d-4577-8bf7-c1d4315a1294 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:33.906358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c3270-8ce9-4cc5-a86f-a0d25e503581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:33.907227 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3270-8ce9-4cc5-a86f-a0d25e503581 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:33.907517 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3270-8ce9-4cc5-a86f-a0d25e503581 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:33.907989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3270-8ce9-4cc5-a86f-a0d25e503581 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:33.908982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c3270-8ce9-4cc5-a86f-a0d25e503581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:33.911554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c3270-8ce9-4cc5-a86f-a0d25e503581 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:33.921692 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731a2d7-e7ed-4dac-aac9-4c1623a374c9 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:33.925873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 948/1898] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:33.935733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c3270-8ce9-4cc5-a86f-a0d25e503581 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:33.938146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a1f9e-0443-4bcd-9c59-848cace99c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:33.938790 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a1f9e-0443-4bcd-9c59-848cace99c89 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:33.939277 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a1f9e-0443-4bcd-9c59-848cace99c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:33.940226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a1f9e-0443-4bcd-9c59-848cace99c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:33.950016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c3270-8ce9-4cc5-a86f-a0d25e503581 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:33.957887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebde2b-b54b-45ed-8584-50c1b203907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:33.959310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebde2b-b54b-45ed-8584-50c1b203907f admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:33.959630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebde2b-b54b-45ed-8584-50c1b203907f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:33.960165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebde2b-b54b-45ed-8584-50c1b203907f admin admin] PATH_INFO: `/v3/projects/40ad52a6f6fe463e83ed1f7279daccfb/users/d684a3bc3da04bb1b74f2ec69f5d9eda/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:33.962735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a1f9e-0443-4bcd-9c59-848cace99c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:33.965110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a1f9e-0443-4bcd-9c59-848cace99c89 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:33.978291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 951/1899] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:33.985478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebde2b-b54b-45ed-8584-50c1b203907f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ad52a6f6fe463e83ed1f7279daccfb, user_id=d684a3bc3da04bb1b74f2ec69f5d9eda, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:33.989379 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebde2b-b54b-45ed-8584-50c1b203907f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:34.008836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 949/1900] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:33 2022] PUT /identity/v3/projects/40ad52a6f6fe463e83ed1f7279daccfb/users/d684a3bc3da04bb1b74f2ec69f5d9eda/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:34.012945 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a1f9e-0443-4bcd-9c59-848cace99c89 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:34.028129 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a1f9e-0443-4bcd-9c59-848cace99c89 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:34.147544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25b31e-9e5d-4386-898c-67d87624d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:34.148662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25b31e-9e5d-4386-898c-67d87624d647 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:34.149186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25b31e-9e5d-4386-898c-67d87624d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:34.149629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25b31e-9e5d-4386-898c-67d87624d647 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:34.151278 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25b31e-9e5d-4386-898c-67d87624d647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:34.155541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25b31e-9e5d-4386-898c-67d87624d647 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:34.180569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 952/1901] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:49:34.184552 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebde2b-b54b-45ed-8584-50c1b203907f admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:34.197712 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebde2b-b54b-45ed-8584-50c1b203907f admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:34.203026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ec3a1-1c40-41a1-af64-130797cd3db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:34.204200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ec3a1-1c40-41a1-af64-130797cd3db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:34.204498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ec3a1-1c40-41a1-af64-130797cd3db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:34.204768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ec3a1-1c40-41a1-af64-130797cd3db5 admin admin] PATH_INFO: `/v3/projects/40ad52a6f6fe463e83ed1f7279daccfb/users/d684a3bc3da04bb1b74f2ec69f5d9eda/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:34.208109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ec3a1-1c40-41a1-af64-130797cd3db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ad52a6f6fe463e83ed1f7279daccfb, user_id=d684a3bc3da04bb1b74f2ec69f5d9eda, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:34.211026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ec3a1-1c40-41a1-af64-130797cd3db5 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:34.226484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 950/1902] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:34 2022] PUT /identity/v3/projects/40ad52a6f6fe463e83ed1f7279daccfb/users/d684a3bc3da04bb1b74f2ec69f5d9eda/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:34.239078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab79f00-6513-4223-876a-508796148bc2 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:34.239434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab79f00-6513-4223-876a-508796148bc2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:34.239803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab79f00-6513-4223-876a-508796148bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:34.289361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-bab79f00-6513-4223-876a-508796148bc2 None None] MFA Rules not processed for user `d684a3bc3da04bb1b74f2ec69f5d9eda`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:34.290696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-bab79f00-6513-4223-876a-508796148bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:34.559405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 953/1903] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:34.576302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ec3a1-1c40-41a1-af64-130797cd3db5 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:34.578674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-341ec3a1-1c40-41a1-af64-130797cd3db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:34.597697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab79f00-6513-4223-876a-508796148bc2 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:34.599489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-bab79f00-6513-4223-876a-508796148bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:34.718780 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab79f00-6513-4223-876a-508796148bc2 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:34.748524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:34.752006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:34.752006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:34.752462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] PATH_INFO: `/v3/projects/b230d284cdfe4ae79482bcfa7376edfb` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:34.756827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b230d284cdfe4ae79482bcfa7376edfb)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:34.760042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:34.763766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ec3a1-1c40-41a1-af64-130797cd3db5 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:34.781557 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b51c-231a-42d4-9d59-df93598c0158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:34.782531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b51c-231a-42d4-9d59-df93598c0158 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:34.782831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b51c-231a-42d4-9d59-df93598c0158 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:34.783212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b51c-231a-42d4-9d59-df93598c0158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:34.815754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09b51c-231a-42d4-9d59-df93598c0158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:34.821345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09b51c-231a-42d4-9d59-df93598c0158 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:34.836615 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 951/1904] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:49:34.837265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b51c-231a-42d4-9d59-df93598c0158 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:34.847037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2d09b51c-231a-42d4-9d59-df93598c0158 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:34.850318 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b230d284cdfe4ae79482bcfa7376edfb', 'request_id': 'req-d6a17358-3a6b-473b-ae49-d2995d7fbe23'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:34.865666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b230d284cdfe4ae79482bcfa7376edfb', 'request_id': 'req-d6a17358-3a6b-473b-ae49-d2995d7fbe23'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:34.876815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b51c-231a-42d4-9d59-df93598c0158 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:34.881613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b230d284cdfe4ae79482bcfa7376edfb', 'request_id': 'req-d6a17358-3a6b-473b-ae49-d2995d7fbe23'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:34.927474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] The token cache is being invalidate because project b230d284cdfe4ae79482bcfa7376edfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:34.932670 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:34.955745 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:34.966148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 954/1905] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:34 2022] DELETE /identity/v3/projects/b230d284cdfe4ae79482bcfa7376edfb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:34.973088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:34.974725 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:35.043489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:35.056180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:35.056644 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:35.056933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] PATH_INFO: `/v3/projects/0ab03ce8d9a740269523499f1c92501d` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:35.058520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab03ce8d9a740269523499f1c92501d)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:35.060479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:35.153312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab03ce8d9a740269523499f1c92501d', 'request_id': 'req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.175505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab03ce8d9a740269523499f1c92501d', 'request_id': 'req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.191212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab03ce8d9a740269523499f1c92501d', 'request_id': 'req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.218279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a17358-3a6b-473b-ae49-d2995d7fbe23 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:35.231311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] The token cache is being invalidate because project 0ab03ce8d9a740269523499f1c92501d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:35.233471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.236677 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.240690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 952/1906] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:34 2022] DELETE /identity/v3/projects/0ab03ce8d9a740269523499f1c92501d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:35.246997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:35.253441 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:35.350786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:35.352914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:35.353197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:35.353488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] PATH_INFO: `/v3/users/247ba90d3b2c4009834a70d59fec01c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:35.358396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247ba90d3b2c4009834a70d59fec01c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:35.362515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:35.414248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762a1c6-c11c-4c1a-bc4a-f6d639a9530b admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:35.441747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:35.442914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:35.443314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:35.443744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] PATH_INFO: `/v3/users/27323cb63be547d18d91b70fed894786` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:35.452127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27323cb63be547d18d91b70fed894786)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:35.455171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:35.479586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247ba90d3b2c4009834a70d59fec01c9'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.509817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247ba90d3b2c4009834a70d59fec01c9'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.513391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247ba90d3b2c4009834a70d59fec01c9'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.532996 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247ba90d3b2c4009834a70d59fec01c9'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.562876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247ba90d3b2c4009834a70d59fec01c9'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.577489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 955/1907] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:34 2022] DELETE /identity/v3/users/247ba90d3b2c4009834a70d59fec01c9 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:35.622566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27323cb63be547d18d91b70fed894786'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.674362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27323cb63be547d18d91b70fed894786'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.675411 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27323cb63be547d18d91b70fed894786'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.677972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27323cb63be547d18d91b70fed894786'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.693289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27323cb63be547d18d91b70fed894786'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:35.731049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 953/1908] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:35 2022] DELETE /identity/v3/users/27323cb63be547d18d91b70fed894786 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:35.811991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:35.815385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:36.007858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd23e1-8285-4513-88f4-7f37e4a6aee9 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:36.169521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:36.170434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:36.170743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:36.171782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] PATH_INFO: `/v3/users/e56e38fa6eef4cc281849c1ddf65ba3d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:36.176798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56e38fa6eef4cc281849c1ddf65ba3d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:36.181947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:36.276792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:36.279370 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:36.295094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd35e-4e25-46be-b265-5238e4236bb5 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:36.301375 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:36.302899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:36.306357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:36.307388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] PATH_INFO: `/v3/users/5f2db4aeccd941d0b393e69d57e4e084` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:36.309625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2db4aeccd941d0b393e69d57e4e084)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:36.312160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:36.343083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56e38fa6eef4cc281849c1ddf65ba3d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.376395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56e38fa6eef4cc281849c1ddf65ba3d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.377171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56e38fa6eef4cc281849c1ddf65ba3d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.387912 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2db4aeccd941d0b393e69d57e4e084'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.396764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56e38fa6eef4cc281849c1ddf65ba3d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.407150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2db4aeccd941d0b393e69d57e4e084'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.408211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2db4aeccd941d0b393e69d57e4e084'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.408831 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56e38fa6eef4cc281849c1ddf65ba3d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.409192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2db4aeccd941d0b393e69d57e4e084'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.420452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2db4aeccd941d0b393e69d57e4e084'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.430267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 956/1909] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:35 2022] DELETE /identity/v3/users/e56e38fa6eef4cc281849c1ddf65ba3d => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:36.431049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:36.432509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:36.436847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 954/1910] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:36 2022] DELETE /identity/v3/users/5f2db4aeccd941d0b393e69d57e4e084 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:36.437740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:36.450276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:36.558477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5a232-3ea3-47d8-ad64-eb025e41033a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:36.564855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:36.565919 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed83806-7d9d-4bfe-b355-b06963565498 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:36.566191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:36.567232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:36.567838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] PATH_INFO: `/v3/projects/631fa4da7780448d87c102cfadebde26` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:36.569714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=631fa4da7780448d87c102cfadebde26)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:36.572324 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:36.578820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:36.580185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:36.580592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:36.580986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] PATH_INFO: `/v3/projects/b751faf45e2c45308b4442fc2000ccd1` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:36.582940 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b751faf45e2c45308b4442fc2000ccd1)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:36.586085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:36.657216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631fa4da7780448d87c102cfadebde26', 'request_id': 'req-e0928581-449c-414d-b141-cb4a2aeac32d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.673939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631fa4da7780448d87c102cfadebde26', 'request_id': 'req-e0928581-449c-414d-b141-cb4a2aeac32d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.690334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631fa4da7780448d87c102cfadebde26', 'request_id': 'req-e0928581-449c-414d-b141-cb4a2aeac32d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.694077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b751faf45e2c45308b4442fc2000ccd1', 'request_id': 'req-3200f07d-1223-4cdd-800a-d4a09c830f9e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.707103 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b751faf45e2c45308b4442fc2000ccd1', 'request_id': 'req-3200f07d-1223-4cdd-800a-d4a09c830f9e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.707388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] The token cache is being invalidate because project 631fa4da7780448d87c102cfadebde26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:36.707657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.708418 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e0928581-449c-414d-b141-cb4a2aeac32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.715428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 957/1911] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:36 2022] DELETE /identity/v3/projects/631fa4da7780448d87c102cfadebde26 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:36.715428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533bedd-62c7-4967-b9b4-cc3cd49322cc None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:36.715428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533bedd-62c7-4967-b9b4-cc3cd49322cc None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:36.715428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533bedd-62c7-4967-b9b4-cc3cd49322cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:36.729094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b751faf45e2c45308b4442fc2000ccd1', 'request_id': 'req-3200f07d-1223-4cdd-800a-d4a09c830f9e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.740533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8533bedd-62c7-4967-b9b4-cc3cd49322cc None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:36.742081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8533bedd-62c7-4967-b9b4-cc3cd49322cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:36.764509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] The token cache is being invalidate because project b751faf45e2c45308b4442fc2000ccd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:36.764779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.765585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3200f07d-1223-4cdd-800a-d4a09c830f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:36.768065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 955/1912] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:36 2022] DELETE /identity/v3/projects/b751faf45e2c45308b4442fc2000ccd1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:36.770706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902ccd-9c77-42bf-a62c-d808df85ff26 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:36.771222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902ccd-9c77-42bf-a62c-d808df85ff26 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:36.771654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902ccd-9c77-42bf-a62c-d808df85ff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:36.794646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-da902ccd-9c77-42bf-a62c-d808df85ff26 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:36.796025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-da902ccd-9c77-42bf-a62c-d808df85ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:36.836985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 958/1913] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:36.839035 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946961f-9768-4f66-81bb-b5298e58602a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:36.839325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946961f-9768-4f66-81bb-b5298e58602a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:36.839590 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946961f-9768-4f66-81bb-b5298e58602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:36.863164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d946961f-9768-4f66-81bb-b5298e58602a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:36.866016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d946961f-9768-4f66-81bb-b5298e58602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:36.878841 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 959/1914] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:36.880618 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9bf7-5bf5-4f18-8f20-e7b26d908ad1 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:36.880908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9bf7-5bf5-4f18-8f20-e7b26d908ad1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:36.881212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9bf7-5bf5-4f18-8f20-e7b26d908ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:36.887770 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 956/1915] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:36.888848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902ccd-9c77-42bf-a62c-d808df85ff26 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:36.890672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-da902ccd-9c77-42bf-a62c-d808df85ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:36.924405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-08ef9bf7-5bf5-4f18-8f20-e7b26d908ad1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:36.926664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-08ef9bf7-5bf5-4f18-8f20-e7b26d908ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:36.949174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 960/1916] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:36.959266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07d9b0-32e8-4f9b-9a8e-41e743507c95 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:36.959266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07d9b0-32e8-4f9b-9a8e-41e743507c95 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:36.959266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07d9b0-32e8-4f9b-9a8e-41e743507c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:36.978694 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8c07d9b0-32e8-4f9b-9a8e-41e743507c95 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:36.980150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8c07d9b0-32e8-4f9b-9a8e-41e743507c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:36.993782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 961/1917] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:36.993782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07d9b0-32e8-4f9b-9a8e-41e743507c95 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:36.993782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8c07d9b0-32e8-4f9b-9a8e-41e743507c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:37.007350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902ccd-9c77-42bf-a62c-d808df85ff26 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:37.008310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07d9b0-32e8-4f9b-9a8e-41e743507c95 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:37.013060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e157e5a-7359-4161-a603-bbb580de3a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:37.013060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e157e5a-7359-4161-a603-bbb580de3a7a service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:37.015770 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e157e5a-7359-4161-a603-bbb580de3a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:37.015770 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e157e5a-7359-4161-a603-bbb580de3a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:37.018382 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb808b82-7a69-4b51-a7da-4515ebb190af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:37.020101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808b82-7a69-4b51-a7da-4515ebb190af service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:37.020582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808b82-7a69-4b51-a7da-4515ebb190af service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:37.021049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808b82-7a69-4b51-a7da-4515ebb190af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:37.034963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e157e5a-7359-4161-a603-bbb580de3a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:37.038933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb808b82-7a69-4b51-a7da-4515ebb190af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:37.039422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e157e5a-7359-4161-a603-bbb580de3a7a service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:37.043776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb808b82-7a69-4b51-a7da-4515ebb190af service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:37.061404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 962/1918] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:37.063023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19d5a6-15e4-460d-8584-ed20c463b425 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:37.063317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19d5a6-15e4-460d-8584-ed20c463b425 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:37.063593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19d5a6-15e4-460d-8584-ed20c463b425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:37.074309 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 957/1919] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:37.075592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e157e5a-7359-4161-a603-bbb580de3a7a service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:37.094856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-6f19d5a6-15e4-460d-8584-ed20c463b425 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:37.098868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-6f19d5a6-15e4-460d-8584-ed20c463b425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:37.107026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e157e5a-7359-4161-a603-bbb580de3a7a service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:37.117858 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff74349-0e8b-4032-9297-ba4d781a6773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:37.119386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff74349-0e8b-4032-9297-ba4d781a6773 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:37.120019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff74349-0e8b-4032-9297-ba4d781a6773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:37.120601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff74349-0e8b-4032-9297-ba4d781a6773 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:37.123305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff74349-0e8b-4032-9297-ba4d781a6773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:49:37.123881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff74349-0e8b-4032-9297-ba4d781a6773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:37.125072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 963/1920] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:37.133647 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19d5a6-15e4-460d-8584-ed20c463b425 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:37.135427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff74349-0e8b-4032-9297-ba4d781a6773 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:37.182072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19d5a6-15e4-460d-8584-ed20c463b425 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:37.202157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 958/1921] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:49:37.210921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097072c3-da2f-4923-b85c-f9e659cd5d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:37.211818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097072c3-da2f-4923-b85c-f9e659cd5d20 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:37.212277 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097072c3-da2f-4923-b85c-f9e659cd5d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:37.212720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097072c3-da2f-4923-b85c-f9e659cd5d20 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:37.212849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff74349-0e8b-4032-9297-ba4d781a6773 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:37.219893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097072c3-da2f-4923-b85c-f9e659cd5d20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:49:37.220413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097072c3-da2f-4923-b85c-f9e659cd5d20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:37.228978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097072c3-da2f-4923-b85c-f9e659cd5d20 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:37.259167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff74349-0e8b-4032-9297-ba4d781a6773 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:37.272640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b548a85-e9cc-45ef-b416-eff419ce3759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:37.274605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b548a85-e9cc-45ef-b416-eff419ce3759 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:37.275294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b548a85-e9cc-45ef-b416-eff419ce3759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:37.276185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b548a85-e9cc-45ef-b416-eff419ce3759 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:37.277348 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b548a85-e9cc-45ef-b416-eff419ce3759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:37.284812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b548a85-e9cc-45ef-b416-eff419ce3759 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:37.298691 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 964/1922] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:49:37.301005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097072c3-da2f-4923-b85c-f9e659cd5d20 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:37.330370 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 959/1923] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:37 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:37.336822 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b548a85-e9cc-45ef-b416-eff419ce3759 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:37.337807 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097072c3-da2f-4923-b85c-f9e659cd5d20 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:37.553083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac7989-d887-40d3-b564-6f0c99bae53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:37.554825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac7989-d887-40d3-b564-6f0c99bae53f admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:37.559123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b548a85-e9cc-45ef-b416-eff419ce3759 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:37.559955 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac7989-d887-40d3-b564-6f0c99bae53f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:37.560576 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac7989-d887-40d3-b564-6f0c99bae53f admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:37.562087 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac7989-d887-40d3-b564-6f0c99bae53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:37.568199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac7989-d887-40d3-b564-6f0c99bae53f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:37.569006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a384440-9e7c-4284-a143-6d8717564d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:37.569660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384440-9e7c-4284-a143-6d8717564d21 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:37.570013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384440-9e7c-4284-a143-6d8717564d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:37.570358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384440-9e7c-4284-a143-6d8717564d21 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:37.571155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a384440-9e7c-4284-a143-6d8717564d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:37.573346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a384440-9e7c-4284-a143-6d8717564d21 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:37.616688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 960/1924] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:37 2022] POST /identity/v3/users => generated 292 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:37.622307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a384440-9e7c-4284-a143-6d8717564d21 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:37.635940 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a384440-9e7c-4284-a143-6d8717564d21 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:37.649489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fef97-5831-47ca-802c-f52d9203b694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:37.652727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fef97-5831-47ca-802c-f52d9203b694 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:37.656203 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fef97-5831-47ca-802c-f52d9203b694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:37.657680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fef97-5831-47ca-802c-f52d9203b694 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:37.658778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fef97-5831-47ca-802c-f52d9203b694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:37.670056 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fef97-5831-47ca-802c-f52d9203b694 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:37.682226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 965/1925] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:37 2022] POST /identity/v3/projects => generated 409 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:37.689935 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac7989-d887-40d3-b564-6f0c99bae53f admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:37.737085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 961/1926] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:37.739107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fef97-5831-47ca-802c-f52d9203b694 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:37.781542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fef97-5831-47ca-802c-f52d9203b694 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:37.824272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac7989-d887-40d3-b564-6f0c99bae53f admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:37.831467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8610308-c65c-465d-ba15-5b37fcbc3d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:37.832773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8610308-c65c-465d-ba15-5b37fcbc3d7d admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:37.832773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8610308-c65c-465d-ba15-5b37fcbc3d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:37.833135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8610308-c65c-465d-ba15-5b37fcbc3d7d admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:37.833694 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8610308-c65c-465d-ba15-5b37fcbc3d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:37.837372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8610308-c65c-465d-ba15-5b37fcbc3d7d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:37.914721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 966/1927] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:37 2022] POST /identity/v3/users => generated 305 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:49:37.914721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8610308-c65c-465d-ba15-5b37fcbc3d7d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:37.917797 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e8610308-c65c-465d-ba15-5b37fcbc3d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:37.966716 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8610308-c65c-465d-ba15-5b37fcbc3d7d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:37.982996 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:37.984037 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:37.984206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:37.984525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] PATH_INFO: `/v3/projects/724cd36d04304add9a366367045a320d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:37.989218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724cd36d04304add9a366367045a320d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:37.991764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:38.007027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a427e3-c442-4cdc-97f8-dd8d75b8ccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:38.008189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a427e3-c442-4cdc-97f8-dd8d75b8ccc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:38.008696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a427e3-c442-4cdc-97f8-dd8d75b8ccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:38.009162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a427e3-c442-4cdc-97f8-dd8d75b8ccc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:38.010772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a427e3-c442-4cdc-97f8-dd8d75b8ccc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:38.013757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a427e3-c442-4cdc-97f8-dd8d75b8ccc4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:38.047603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 962/1928] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:38.048653 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a427e3-c442-4cdc-97f8-dd8d75b8ccc4 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:38.068090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a427e3-c442-4cdc-97f8-dd8d75b8ccc4 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:38.076646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169277c6-468d-4dd1-99e8-2ddca91a2e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:38.077825 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169277c6-468d-4dd1-99e8-2ddca91a2e5a admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:38.078331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169277c6-468d-4dd1-99e8-2ddca91a2e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:38.078824 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169277c6-468d-4dd1-99e8-2ddca91a2e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:38.080435 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169277c6-468d-4dd1-99e8-2ddca91a2e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:38.083595 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169277c6-468d-4dd1-99e8-2ddca91a2e5a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:38.105877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 963/1929] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:38.107531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169277c6-468d-4dd1-99e8-2ddca91a2e5a admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:38.110892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-169277c6-468d-4dd1-99e8-2ddca91a2e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:38.113932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724cd36d04304add9a366367045a320d', 'request_id': 'req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.127582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724cd36d04304add9a366367045a320d', 'request_id': 'req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.138147 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169277c6-468d-4dd1-99e8-2ddca91a2e5a admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:38.144515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724cd36d04304add9a366367045a320d', 'request_id': 'req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.166752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] The token cache is being invalidate because project 724cd36d04304add9a366367045a320d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:38.167801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.179926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.183095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 967/1930] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:37 2022] DELETE /identity/v3/projects/724cd36d04304add9a366367045a320d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:38.186387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:38.189245 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:38.217831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:38.219021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:38.219427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:38.219586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] PATH_INFO: `/v3/projects/6c791776bb7c4aec99853df54b602fb1` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:38.220995 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c791776bb7c4aec99853df54b602fb1)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:38.228011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:38.308465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c791776bb7c4aec99853df54b602fb1', 'request_id': 'req-e287ba89-9e90-4163-bd39-ed51e9464a91'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.309598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01d1b7-9aef-4761-8fd2-1d5c4186b2e0 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:38.320625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c791776bb7c4aec99853df54b602fb1', 'request_id': 'req-e287ba89-9e90-4163-bd39-ed51e9464a91'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.332561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c791776bb7c4aec99853df54b602fb1', 'request_id': 'req-e287ba89-9e90-4163-bd39-ed51e9464a91'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.350937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] The token cache is being invalidate because project 6c791776bb7c4aec99853df54b602fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:38.351289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.352302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.354838 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 964/1931] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:38 2022] DELETE /identity/v3/projects/6c791776bb7c4aec99853df54b602fb1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:38.356040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:38.357585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:38.411100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a6bd-51fb-4345-9e01-0d525e0b033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:38.413390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a6bd-51fb-4345-9e01-0d525e0b033d admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:38.413390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a6bd-51fb-4345-9e01-0d525e0b033d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:38.413390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a6bd-51fb-4345-9e01-0d525e0b033d admin admin] PATH_INFO: `/v3/projects/affc7dc521c94da3b20e2a9438d1b5bc/users/6e0c8a485e64418b88e0284956b4e330/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:38.433923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25a6bd-51fb-4345-9e01-0d525e0b033d admin admin] RBAC: Authorizing `identity:create_grant(project_id=affc7dc521c94da3b20e2a9438d1b5bc, user_id=6e0c8a485e64418b88e0284956b4e330, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:38.439676 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25a6bd-51fb-4345-9e01-0d525e0b033d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:38.450665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287ba89-9e90-4163-bd39-ed51e9464a91 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:38.456579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955c77f-9137-4f07-959d-b6dd0110a224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:38.457415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955c77f-9137-4f07-959d-b6dd0110a224 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:38.457927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955c77f-9137-4f07-959d-b6dd0110a224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:38.458286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955c77f-9137-4f07-959d-b6dd0110a224 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:38.459050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955c77f-9137-4f07-959d-b6dd0110a224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:38.460747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955c77f-9137-4f07-959d-b6dd0110a224 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:38.465711 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 968/1932] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:38 2022] PUT /identity/v3/projects/affc7dc521c94da3b20e2a9438d1b5bc/users/6e0c8a485e64418b88e0284956b4e330/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:38.467272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a6bd-51fb-4345-9e01-0d525e0b033d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:38.470014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-df25a6bd-51fb-4345-9e01-0d525e0b033d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:38.486467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 965/1933] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:38.488082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955c77f-9137-4f07-959d-b6dd0110a224 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:38.492619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c955c77f-9137-4f07-959d-b6dd0110a224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:38.517565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955c77f-9137-4f07-959d-b6dd0110a224 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:38.562207 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a6bd-51fb-4345-9e01-0d525e0b033d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:38.570724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacce8c-74a5-4eb7-8c83-3c1670795c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:38.572360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacce8c-74a5-4eb7-8c83-3c1670795c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:38.572884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacce8c-74a5-4eb7-8c83-3c1670795c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:38.573405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacce8c-74a5-4eb7-8c83-3c1670795c51 admin admin] PATH_INFO: `/v3/users/d684a3bc3da04bb1b74f2ec69f5d9eda` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:38.575743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacce8c-74a5-4eb7-8c83-3c1670795c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d684a3bc3da04bb1b74f2ec69f5d9eda)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:38.579684 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacce8c-74a5-4eb7-8c83-3c1670795c51 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:38.604205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:38.605601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:38.606021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:38.606526 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] PATH_INFO: `/v3/users/0bf4e0df48354a5ab9bd56c9638d998d` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:38.608478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf4e0df48354a5ab9bd56c9638d998d)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:38.611043 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:38.662546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fbacce8c-74a5-4eb7-8c83-3c1670795c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd684a3bc3da04bb1b74f2ec69f5d9eda'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.685488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fbacce8c-74a5-4eb7-8c83-3c1670795c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd684a3bc3da04bb1b74f2ec69f5d9eda'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.686434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fbacce8c-74a5-4eb7-8c83-3c1670795c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd684a3bc3da04bb1b74f2ec69f5d9eda'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.690074 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf4e0df48354a5ab9bd56c9638d998d'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.699775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fbacce8c-74a5-4eb7-8c83-3c1670795c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd684a3bc3da04bb1b74f2ec69f5d9eda'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.713936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fbacce8c-74a5-4eb7-8c83-3c1670795c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd684a3bc3da04bb1b74f2ec69f5d9eda'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.718891 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf4e0df48354a5ab9bd56c9638d998d'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.720445 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf4e0df48354a5ab9bd56c9638d998d'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.721247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf4e0df48354a5ab9bd56c9638d998d'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.727798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 969/1934] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:38 2022] DELETE /identity/v3/users/d684a3bc3da04bb1b74f2ec69f5d9eda => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:38.727798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51770-64d2-40a3-b413-d57e4f45e7fe None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:38.728200 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51770-64d2-40a3-b413-d57e4f45e7fe None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:38.729219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51770-64d2-40a3-b413-d57e4f45e7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:38.742438 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf4e0df48354a5ab9bd56c9638d998d'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:38.762662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 966/1935] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:38 2022] DELETE /identity/v3/users/0bf4e0df48354a5ab9bd56c9638d998d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:38.766411 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:38.768048 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:38.790011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-0ec51770-64d2-40a3-b413-d57e4f45e7fe None None] MFA Rules not processed for user `6e0c8a485e64418b88e0284956b4e330`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:38.792476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0ec51770-64d2-40a3-b413-d57e4f45e7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:38.852605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33219f86-ab9f-4e1d-a847-c18f423b57dd admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:38.859685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543cb82-a03e-4713-a30d-f551dad4d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:38.860654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543cb82-a03e-4713-a30d-f551dad4d688 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:38.861095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543cb82-a03e-4713-a30d-f551dad4d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:38.861389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543cb82-a03e-4713-a30d-f551dad4d688 admin admin] PATH_INFO: `/v3/projects/e80dad8edbc648748a6f605081dcee6e/users/faa8b36110914c54a1b304db2bdffd34/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:38.893827 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543cb82-a03e-4713-a30d-f551dad4d688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80dad8edbc648748a6f605081dcee6e, user_id=faa8b36110914c54a1b304db2bdffd34, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:38.894085 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 970/1936] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:38.894510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543cb82-a03e-4713-a30d-f551dad4d688 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:38.895589 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec51770-64d2-40a3-b413-d57e4f45e7fe None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:38.899857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0ec51770-64d2-40a3-b413-d57e4f45e7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:38.914011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 967/1937] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:38 2022] PUT /identity/v3/projects/e80dad8edbc648748a6f605081dcee6e/users/faa8b36110914c54a1b304db2bdffd34/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:38.936989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d0e1-d777-4dea-9127-bf24bf141907 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:38.936989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d0e1-d777-4dea-9127-bf24bf141907 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:38.936989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d0e1-d777-4dea-9127-bf24bf141907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:38.978326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec51770-64d2-40a3-b413-d57e4f45e7fe None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:39.009654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4810d0e1-d777-4dea-9127-bf24bf141907 None None] MFA Rules not processed for user `faa8b36110914c54a1b304db2bdffd34`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:39.012073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4810d0e1-d777-4dea-9127-bf24bf141907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:39.132983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b282900-0344-4b31-aa68-fe6f720e690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:39.133664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282900-0344-4b31-aa68-fe6f720e690b admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:39.134517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282900-0344-4b31-aa68-fe6f720e690b admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:39.134817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282900-0344-4b31-aa68-fe6f720e690b admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:39.135547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b282900-0344-4b31-aa68-fe6f720e690b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:39.137562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b282900-0344-4b31-aa68-fe6f720e690b admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:39.176263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 971/1938] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:38 2022] POST /identity/v3/projects => generated 381 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:39.178981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b282900-0344-4b31-aa68-fe6f720e690b admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:39.203472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 968/1939] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:39.215606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d0e1-d777-4dea-9127-bf24bf141907 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:39.246134 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d0e1-d777-4dea-9127-bf24bf141907 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:39.307749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b282900-0344-4b31-aa68-fe6f720e690b admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:39.314808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201da4e3-32a2-409b-82d6-448483f51ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:39.315992 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201da4e3-32a2-409b-82d6-448483f51ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:39.316343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201da4e3-32a2-409b-82d6-448483f51ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:39.317123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201da4e3-32a2-409b-82d6-448483f51ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:39.318455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201da4e3-32a2-409b-82d6-448483f51ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:39.323877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201da4e3-32a2-409b-82d6-448483f51ce8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:39.370927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e78555-864b-420b-8f44-547d29547520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:39.372477 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78555-864b-420b-8f44-547d29547520 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:39.372792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78555-864b-420b-8f44-547d29547520 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:39.373315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78555-864b-420b-8f44-547d29547520 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:39.374570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e78555-864b-420b-8f44-547d29547520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:39.383834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 972/1940] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:39 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:39.384053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e78555-864b-420b-8f44-547d29547520 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:39.384137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201da4e3-32a2-409b-82d6-448483f51ce8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:39.386573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-201da4e3-32a2-409b-82d6-448483f51ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:39.415186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201da4e3-32a2-409b-82d6-448483f51ce8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:39.424953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:39.427649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:39.428396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:39.429160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] PATH_INFO: `/v3/projects/40ad52a6f6fe463e83ed1f7279daccfb` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:39.431659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ad52a6f6fe463e83ed1f7279daccfb)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:39.435277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 969/1941] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:39 2022] POST /identity/v3/projects => generated 407 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:39.436359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e78555-864b-420b-8f44-547d29547520 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:39.437525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:39.521737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ad52a6f6fe463e83ed1f7279daccfb', 'request_id': 'req-73ccc26e-f8c2-4558-bdce-931e835fc232'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:39.525265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e78555-864b-420b-8f44-547d29547520 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:39.534848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ad52a6f6fe463e83ed1f7279daccfb', 'request_id': 'req-73ccc26e-f8c2-4558-bdce-931e835fc232'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:39.554305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ad52a6f6fe463e83ed1f7279daccfb', 'request_id': 'req-73ccc26e-f8c2-4558-bdce-931e835fc232'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:39.585506 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] The token cache is being invalidate because project 40ad52a6f6fe463e83ed1f7279daccfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:39.586234 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:39.586696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:39.594146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 973/1942] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:39 2022] DELETE /identity/v3/projects/40ad52a6f6fe463e83ed1f7279daccfb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:39.595657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:39.600653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:39.642573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87f44-edcc-4a52-ad45-2746ea7ad2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:39.643417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87f44-edcc-4a52-ad45-2746ea7ad2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:39.643780 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87f44-edcc-4a52-ad45-2746ea7ad2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:39.644072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87f44-edcc-4a52-ad45-2746ea7ad2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:39.645645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87f44-edcc-4a52-ad45-2746ea7ad2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:39.647578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87f44-edcc-4a52-ad45-2746ea7ad2c4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:39.660715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 970/1943] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:39.662382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd694f9-e51f-469f-b896-90c7aaeacc60 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:39.662726 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd694f9-e51f-469f-b896-90c7aaeacc60 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:39.663007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd694f9-e51f-469f-b896-90c7aaeacc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:39.689608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc26e-f8c2-4558-bdce-931e835fc232 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:39.689834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-acd694f9-e51f-469f-b896-90c7aaeacc60 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:39.691953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-acd694f9-e51f-469f-b896-90c7aaeacc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:39.697954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf848a26-03ff-445b-9591-82b58d8a0b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:39.698658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf848a26-03ff-445b-9591-82b58d8a0b40 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:39.698938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf848a26-03ff-445b-9591-82b58d8a0b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:39.699210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf848a26-03ff-445b-9591-82b58d8a0b40 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:39.700520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf848a26-03ff-445b-9591-82b58d8a0b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:39.702389 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf848a26-03ff-445b-9591-82b58d8a0b40 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:39.705152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 971/1944] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:39.715344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd694f9-e51f-469f-b896-90c7aaeacc60 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:39.716980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-acd694f9-e51f-469f-b896-90c7aaeacc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:39.738973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 974/1945] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:39 2022] POST /identity/v3/users => generated 310 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:39.738973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c141-95fd-46ca-b43f-813923868c8f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:39.738973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c141-95fd-46ca-b43f-813923868c8f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:39.739471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd694f9-e51f-469f-b896-90c7aaeacc60 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:39.739663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3c141-95fd-46ca-b43f-813923868c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:39.743568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bb4a7-19a5-4b7d-b40b-d38019fb330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:39.746357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bb4a7-19a5-4b7d-b40b-d38019fb330c admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:39.746678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bb4a7-19a5-4b7d-b40b-d38019fb330c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:39.748355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bb4a7-19a5-4b7d-b40b-d38019fb330c admin admin] PATH_INFO: `/v3/projects/e2ac2b0545834526a8b2d668e9fca91b/users/5b55714cd84142cbac58d88fef1a2227/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:39.771535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a7d3c141-95fd-46ca-b43f-813923868c8f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:39.773748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a7d3c141-95fd-46ca-b43f-813923868c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:39.777601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bb4a7-19a5-4b7d-b40b-d38019fb330c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ac2b0545834526a8b2d668e9fca91b, user_id=5b55714cd84142cbac58d88fef1a2227, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:39.781554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bb4a7-19a5-4b7d-b40b-d38019fb330c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:39.801361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 975/1946] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:39.801361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3c141-95fd-46ca-b43f-813923868c8f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:39.817750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 972/1947] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:39 2022] PUT /identity/v3/projects/e2ac2b0545834526a8b2d668e9fca91b/users/5b55714cd84142cbac58d88fef1a2227/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:39.819380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bb4a7-19a5-4b7d-b40b-d38019fb330c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:39.822638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ef6bb4a7-19a5-4b7d-b40b-d38019fb330c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:39.823663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3c141-95fd-46ca-b43f-813923868c8f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:39.986605 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf9718-33f7-406b-af20-24d0b2d28ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:39.987357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf9718-33f7-406b-af20-24d0b2d28ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:39.987641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf9718-33f7-406b-af20-24d0b2d28ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:39.988194 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf9718-33f7-406b-af20-24d0b2d28ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:39.990765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf9718-33f7-406b-af20-24d0b2d28ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:39.992488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf9718-33f7-406b-af20-24d0b2d28ab4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:40.002640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bb4a7-19a5-4b7d-b40b-d38019fb330c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:40.005627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 976/1948] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:40.006512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf9718-33f7-406b-af20-24d0b2d28ab4 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:40.016557 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:40.017567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.018019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.018508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] PATH_INFO: `/v3/projects/50dbfc64ba0f42ff96103b0e50f905fc` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.023457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50dbfc64ba0f42ff96103b0e50f905fc)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:40.029142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:40.034356 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf9718-33f7-406b-af20-24d0b2d28ab4 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:40.042365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72eedd8-d639-418c-815e-1442b1b4b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:40.043056 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72eedd8-d639-418c-815e-1442b1b4b91c admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.043336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72eedd8-d639-418c-815e-1442b1b4b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.043612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72eedd8-d639-418c-815e-1442b1b4b91c admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.044392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72eedd8-d639-418c-815e-1442b1b4b91c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:49:40.044699 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72eedd8-d639-418c-815e-1442b1b4b91c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:40.046945 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72eedd8-d639-418c-815e-1442b1b4b91c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:40.063673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 977/1949] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:49:40.068941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72eedd8-d639-418c-815e-1442b1b4b91c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:40.090546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72eedd8-d639-418c-815e-1442b1b4b91c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:40.101237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c868d-e68a-405e-b00e-073d7e717956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:40.102936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c868d-e68a-405e-b00e-073d7e717956 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.103622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c868d-e68a-405e-b00e-073d7e717956 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.104345 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c868d-e68a-405e-b00e-073d7e717956 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.106166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c868d-e68a-405e-b00e-073d7e717956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:40.107351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c868d-e68a-405e-b00e-073d7e717956 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:40.118870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 978/1950] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:40.119750 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c868d-e68a-405e-b00e-073d7e717956 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:40.130443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c868d-e68a-405e-b00e-073d7e717956 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:40.152615 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50dbfc64ba0f42ff96103b0e50f905fc', 'request_id': 'req-37776085-f4ba-4658-8e7e-6d39e8460a11'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:40.164187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50dbfc64ba0f42ff96103b0e50f905fc', 'request_id': 'req-37776085-f4ba-4658-8e7e-6d39e8460a11'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:40.179218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50dbfc64ba0f42ff96103b0e50f905fc', 'request_id': 'req-37776085-f4ba-4658-8e7e-6d39e8460a11'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:40.198068 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] The token cache is being invalidate because project 50dbfc64ba0f42ff96103b0e50f905fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:40.198585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:40.199703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:40.202905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 973/1951] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:39 2022] DELETE /identity/v3/projects/50dbfc64ba0f42ff96103b0e50f905fc => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:40.204393 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:40.206703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:40.223935 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c22cc1-e012-41eb-b405-d676184b8c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:40.225725 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c22cc1-e012-41eb-b405-d676184b8c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.225912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c22cc1-e012-41eb-b405-d676184b8c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.226190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c22cc1-e012-41eb-b405-d676184b8c58 admin admin] PATH_INFO: `/v3/projects/a324b31806874672800e9f51b16f1c6c/users/47d5e09dc5154ad992a325419bcc319e/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.252933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c22cc1-e012-41eb-b405-d676184b8c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a324b31806874672800e9f51b16f1c6c, user_id=47d5e09dc5154ad992a325419bcc319e, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:40.257050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c22cc1-e012-41eb-b405-d676184b8c58 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:40.283009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 979/1952] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:40 2022] PUT /identity/v3/projects/a324b31806874672800e9f51b16f1c6c/users/47d5e09dc5154ad992a325419bcc319e/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:40.283009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c22cc1-e012-41eb-b405-d676184b8c58 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:40.284075 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-62c22cc1-e012-41eb-b405-d676184b8c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:40.315186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37776085-f4ba-4658-8e7e-6d39e8460a11 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:40.396556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c22cc1-e012-41eb-b405-d676184b8c58 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:40.397636 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbe1bc-da28-4ba2-9355-c79dad37bcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:40.398390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbe1bc-da28-4ba2-9355-c79dad37bcf5 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.398791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbe1bc-da28-4ba2-9355-c79dad37bcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.399071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbe1bc-da28-4ba2-9355-c79dad37bcf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.400004 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbe1bc-da28-4ba2-9355-c79dad37bcf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:40.401832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b625b-c43d-40fb-be1f-866e88619f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:40.402047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbe1bc-da28-4ba2-9355-c79dad37bcf5 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:40.402736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b625b-c43d-40fb-be1f-866e88619f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.403124 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b625b-c43d-40fb-be1f-866e88619f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.403456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b625b-c43d-40fb-be1f-866e88619f7a admin admin] PATH_INFO: `/v3/projects/e2ac2b0545834526a8b2d668e9fca91b/users/5b55714cd84142cbac58d88fef1a2227/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.405568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b625b-c43d-40fb-be1f-866e88619f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ac2b0545834526a8b2d668e9fca91b, user_id=5b55714cd84142cbac58d88fef1a2227, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:40.408290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b625b-c43d-40fb-be1f-866e88619f7a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:40.447364 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 980/1953] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:40 2022] PUT /identity/v3/projects/e2ac2b0545834526a8b2d668e9fca91b/users/5b55714cd84142cbac58d88fef1a2227/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:40.447655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 974/1954] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:40 2022] POST /identity/v3/projects => generated 375 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:40.447655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbe1bc-da28-4ba2-9355-c79dad37bcf5 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:40.447959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bbc1b-8c50-44ce-9781-b04257ea49cd None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.447959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bbc1b-8c50-44ce-9781-b04257ea49cd None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.447959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bbc1b-8c50-44ce-9781-b04257ea49cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.454314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ebcbe1bc-da28-4ba2-9355-c79dad37bcf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:40.494471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-712bbc1b-8c50-44ce-9781-b04257ea49cd None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:40.496849 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-712bbc1b-8c50-44ce-9781-b04257ea49cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:40.571665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbe1bc-da28-4ba2-9355-c79dad37bcf5 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:40.579874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5d6b3-9fca-447d-b3f5-476e78968007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:40.580662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5d6b3-9fca-447d-b3f5-476e78968007 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.581075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5d6b3-9fca-447d-b3f5-476e78968007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.581432 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5d6b3-9fca-447d-b3f5-476e78968007 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.583039 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5d6b3-9fca-447d-b3f5-476e78968007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:40.584774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5d6b3-9fca-447d-b3f5-476e78968007 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:40.598750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 975/1955] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:40.602688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5d6b3-9fca-447d-b3f5-476e78968007 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:40.615544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5d6b3-9fca-447d-b3f5-476e78968007 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:40.622607 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8638f3-adbb-4994-a796-492bdb9cea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:40.624331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8638f3-adbb-4994-a796-492bdb9cea52 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.625203 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8638f3-adbb-4994-a796-492bdb9cea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.626459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8638f3-adbb-4994-a796-492bdb9cea52 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.628014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8638f3-adbb-4994-a796-492bdb9cea52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:40.632986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8638f3-adbb-4994-a796-492bdb9cea52 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:40.637785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 981/1956] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:40.639142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277306-f0e0-4813-aab0-a5aeb9c436e3 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.639434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277306-f0e0-4813-aab0-a5aeb9c436e3 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.639742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277306-f0e0-4813-aab0-a5aeb9c436e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.671291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-e0277306-f0e0-4813-aab0-a5aeb9c436e3 None None] MFA Rules not processed for user `5b55714cd84142cbac58d88fef1a2227`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:40.672666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e0277306-f0e0-4813-aab0-a5aeb9c436e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:40.697593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 976/1957] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:40 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:40.699435 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8638f3-adbb-4994-a796-492bdb9cea52 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:40.727020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8638f3-adbb-4994-a796-492bdb9cea52 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:40.732810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e3e8a-0a95-4568-b61f-4a769abe49b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:40.733682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3e8a-0a95-4568-b61f-4a769abe49b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.734038 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3e8a-0a95-4568-b61f-4a769abe49b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.734387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3e8a-0a95-4568-b61f-4a769abe49b0 admin admin] PATH_INFO: `/v3/projects/a324b31806874672800e9f51b16f1c6c/users/47d5e09dc5154ad992a325419bcc319e/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.736609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e3e8a-0a95-4568-b61f-4a769abe49b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a324b31806874672800e9f51b16f1c6c, user_id=47d5e09dc5154ad992a325419bcc319e, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:40.740527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e3e8a-0a95-4568-b61f-4a769abe49b0 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:40.753503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 977/1958] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:40 2022] PUT /identity/v3/projects/a324b31806874672800e9f51b16f1c6c/users/47d5e09dc5154ad992a325419bcc319e/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:40.755558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aea78-b2a3-4272-8ca9-c97fb28fd873 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.755939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aea78-b2a3-4272-8ca9-c97fb28fd873 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.756316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617aea78-b2a3-4272-8ca9-c97fb28fd873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.778927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 982/1959] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:40.781044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0277306-f0e0-4813-aab0-a5aeb9c436e3 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:40.781716 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-617aea78-b2a3-4272-8ca9-c97fb28fd873 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:40.784686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-617aea78-b2a3-4272-8ca9-c97fb28fd873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:40.794678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0277306-f0e0-4813-aab0-a5aeb9c436e3 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:40.867057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 978/1960] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:40.868956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2500b-1858-4163-bcae-f71dee608362 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.869325 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2500b-1858-4163-bcae-f71dee608362 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.869684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2500b-1858-4163-bcae-f71dee608362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.873150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c442b1-f016-40a4-910d-922dc8773bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:40.874257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c442b1-f016-40a4-910d-922dc8773bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:40.874758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c442b1-f016-40a4-910d-922dc8773bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:40.875370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c442b1-f016-40a4-910d-922dc8773bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:40.876916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c442b1-f016-40a4-910d-922dc8773bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:40.879495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c442b1-f016-40a4-910d-922dc8773bf8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:40.894528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 983/1961] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:40.895413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c442b1-f016-40a4-910d-922dc8773bf8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:40.897122 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-40c442b1-f016-40a4-910d-922dc8773bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:40.901873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-bbc2500b-1858-4163-bcae-f71dee608362 None None] MFA Rules not processed for user `47d5e09dc5154ad992a325419bcc319e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:40.903085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-bbc2500b-1858-4163-bcae-f71dee608362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:41.020650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 979/1962] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:40 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:41.022740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2500b-1858-4163-bcae-f71dee608362 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:41.033962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c442b1-f016-40a4-910d-922dc8773bf8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:41.035657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2500b-1858-4163-bcae-f71dee608362 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:41.041018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76174de5-4bd2-4353-986d-d383b677cc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:41.041797 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76174de5-4bd2-4353-986d-d383b677cc29 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:41.042062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54af6d-7cbc-4b33-86f3-4e1583a97b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:41.042228 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76174de5-4bd2-4353-986d-d383b677cc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:41.042360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76174de5-4bd2-4353-986d-d383b677cc29 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:41.043079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76174de5-4bd2-4353-986d-d383b677cc29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:49:41.043386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76174de5-4bd2-4353-986d-d383b677cc29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:41.045249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54af6d-7cbc-4b33-86f3-4e1583a97b7a service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:41.045882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54af6d-7cbc-4b33-86f3-4e1583a97b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:41.046500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54af6d-7cbc-4b33-86f3-4e1583a97b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:41.046671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76174de5-4bd2-4353-986d-d383b677cc29 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:41.069700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 980/1963] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:49:41.070601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76174de5-4bd2-4353-986d-d383b677cc29 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:41.088179 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76174de5-4bd2-4353-986d-d383b677cc29 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:41.098147 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86997c6a-9c71-46f4-bd6d-a687e318a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:41.099291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997c6a-9c71-46f4-bd6d-a687e318a046 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:41.099807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997c6a-9c71-46f4-bd6d-a687e318a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:41.100299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997c6a-9c71-46f4-bd6d-a687e318a046 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:41.101680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86997c6a-9c71-46f4-bd6d-a687e318a046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:41.108033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86997c6a-9c71-46f4-bd6d-a687e318a046 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:41.131847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54af6d-7cbc-4b33-86f3-4e1583a97b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:41.136700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 981/1964] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:41.136700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86997c6a-9c71-46f4-bd6d-a687e318a046 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:41.137553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54af6d-7cbc-4b33-86f3-4e1583a97b7a service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:41.138742 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-86997c6a-9c71-46f4-bd6d-a687e318a046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:41.150136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 984/1965] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:41.150901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54af6d-7cbc-4b33-86f3-4e1583a97b7a service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:41.172069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86997c6a-9c71-46f4-bd6d-a687e318a046 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:41.182492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5442a66-37ed-4df2-a0a3-265991c7aa69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:41.183790 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5442a66-37ed-4df2-a0a3-265991c7aa69 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:41.184750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5442a66-37ed-4df2-a0a3-265991c7aa69 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:41.185282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5442a66-37ed-4df2-a0a3-265991c7aa69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:41.192650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54af6d-7cbc-4b33-86f3-4e1583a97b7a service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:41.206580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5442a66-37ed-4df2-a0a3-265991c7aa69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:41.209586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab487-eb0c-4ef3-8ca8-b56b0241c0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:41.210419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab487-eb0c-4ef3-8ca8-b56b0241c0ee admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:41.210708 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab487-eb0c-4ef3-8ca8-b56b0241c0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:41.210876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5442a66-37ed-4df2-a0a3-265991c7aa69 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:41.211060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab487-eb0c-4ef3-8ca8-b56b0241c0ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:41.211685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab487-eb0c-4ef3-8ca8-b56b0241c0ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:41.215346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab487-eb0c-4ef3-8ca8-b56b0241c0ee admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:41.230095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 982/1966] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:41 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:41.231802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5442a66-37ed-4df2-a0a3-265991c7aa69 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:41.266812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5442a66-37ed-4df2-a0a3-265991c7aa69 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:41.280672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6893c95-5bd3-4c2a-9d80-c37432101dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:41.282037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6893c95-5bd3-4c2a-9d80-c37432101dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:41.286835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6893c95-5bd3-4c2a-9d80-c37432101dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:41.290022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6893c95-5bd3-4c2a-9d80-c37432101dfa admin admin] PATH_INFO: `/v3/projects/08dc3aef746542f0944976334e4120f0/users/7730774a21ad488cbcd6ad9e89539fb3/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:41.297631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 985/1967] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:41 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:41.305090 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab487-eb0c-4ef3-8ca8-b56b0241c0ee admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:41.342791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6893c95-5bd3-4c2a-9d80-c37432101dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=08dc3aef746542f0944976334e4120f0, user_id=7730774a21ad488cbcd6ad9e89539fb3, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:41.348827 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6893c95-5bd3-4c2a-9d80-c37432101dfa admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:41.383916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 983/1968] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:41 2022] PUT /identity/v3/projects/08dc3aef746542f0944976334e4120f0/users/7730774a21ad488cbcd6ad9e89539fb3/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:41.398976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf331a-b4a5-4787-ad4b-da25279c0aba None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:41.400139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf331a-b4a5-4787-ad4b-da25279c0aba None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:41.400953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf331a-b4a5-4787-ad4b-da25279c0aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:41.505902 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1dcf331a-b4a5-4787-ad4b-da25279c0aba None None] MFA Rules not processed for user `7730774a21ad488cbcd6ad9e89539fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:41.518395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1dcf331a-b4a5-4787-ad4b-da25279c0aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:41.540377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab487-eb0c-4ef3-8ca8-b56b0241c0ee admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:41.685118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0f1d1-353e-46f1-87cb-d92245ca868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:41.685118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0f1d1-353e-46f1-87cb-d92245ca868b admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:41.685118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0f1d1-353e-46f1-87cb-d92245ca868b admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:41.685118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0f1d1-353e-46f1-87cb-d92245ca868b admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:41.686249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0f1d1-353e-46f1-87cb-d92245ca868b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:41.690511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0f1d1-353e-46f1-87cb-d92245ca868b admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:41.705591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 984/1969] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:41.706449 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf331a-b4a5-4787-ad4b-da25279c0aba None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:41.731960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 986/1970] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:41 2022] POST /identity/v3/users => generated 284 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:41.733745 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0f1d1-353e-46f1-87cb-d92245ca868b admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:41.813302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf331a-b4a5-4787-ad4b-da25279c0aba None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:41.818698 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46e01-d61b-4801-8320-ba04a8eb5ade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:41.819800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46e01-d61b-4801-8320-ba04a8eb5ade service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:41.820239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46e01-d61b-4801-8320-ba04a8eb5ade service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:41.820662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46e01-d61b-4801-8320-ba04a8eb5ade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:41.825118 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1fa46e01-d61b-4801-8320-ba04a8eb5ade service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:41.835742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0f1d1-353e-46f1-87cb-d92245ca868b admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:41.845969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271369bb-6fd3-4e33-b214-b20d8dba5f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:41.848789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271369bb-6fd3-4e33-b214-b20d8dba5f69 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:41.849382 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271369bb-6fd3-4e33-b214-b20d8dba5f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:41.851594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271369bb-6fd3-4e33-b214-b20d8dba5f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:41.856145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-271369bb-6fd3-4e33-b214-b20d8dba5f69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:41.979119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa46e01-d61b-4801-8320-ba04a8eb5ade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:41.980007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271369bb-6fd3-4e33-b214-b20d8dba5f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:41.981480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271369bb-6fd3-4e33-b214-b20d8dba5f69 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:41.982522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa46e01-d61b-4801-8320-ba04a8eb5ade service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:41.997247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 987/1971] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:41.997707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 985/1972] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:41.998116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271369bb-6fd3-4e33-b214-b20d8dba5f69 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:42.010930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271369bb-6fd3-4e33-b214-b20d8dba5f69 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:42.021031 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d3f35-8deb-4d6e-9f0a-d7b68c36ab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:42.022742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3f35-8deb-4d6e-9f0a-d7b68c36ab77 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:42.023032 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3f35-8deb-4d6e-9f0a-d7b68c36ab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:42.023314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3f35-8deb-4d6e-9f0a-d7b68c36ab77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:42.025709 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d3f35-8deb-4d6e-9f0a-d7b68c36ab77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:42.027372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d3f35-8deb-4d6e-9f0a-d7b68c36ab77 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:42.043850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 988/1973] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:42.045827 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46e01-d61b-4801-8320-ba04a8eb5ade service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:42.068646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46e01-d61b-4801-8320-ba04a8eb5ade service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:42.077859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eaaa2-f7b1-4581-a75d-5de639e0d50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:42.078686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eaaa2-f7b1-4581-a75d-5de639e0d50d admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:42.079115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eaaa2-f7b1-4581-a75d-5de639e0d50d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:42.079273 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eaaa2-f7b1-4581-a75d-5de639e0d50d admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:42.080109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eaaa2-f7b1-4581-a75d-5de639e0d50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:42.083540 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eaaa2-f7b1-4581-a75d-5de639e0d50d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:42.105296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 986/1974] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:42.107152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d3f35-8deb-4d6e-9f0a-d7b68c36ab77 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:42.126473 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d3f35-8deb-4d6e-9f0a-d7b68c36ab77 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:42.138397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9303331-8579-419f-94af-9089da5bd257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:42.140985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9303331-8579-419f-94af-9089da5bd257 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:42.141482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9303331-8579-419f-94af-9089da5bd257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:42.142204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9303331-8579-419f-94af-9089da5bd257 admin admin] PATH_INFO: `/v3/projects/ebf4508e126f4f67b9221361f3a2b447/users/2d4f1dc6686d4bafb95a088c49cb4efa/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:42.191077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9303331-8579-419f-94af-9089da5bd257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf4508e126f4f67b9221361f3a2b447, user_id=2d4f1dc6686d4bafb95a088c49cb4efa, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:42.191077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9303331-8579-419f-94af-9089da5bd257 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:42.224010 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 989/1975] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:42 2022] PUT /identity/v3/projects/ebf4508e126f4f67b9221361f3a2b447/users/2d4f1dc6686d4bafb95a088c49cb4efa/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:42.243576 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1cd49-ceab-45eb-a495-780ce3e0606a None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:42.244364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1cd49-ceab-45eb-a495-780ce3e0606a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:42.244760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1cd49-ceab-45eb-a495-780ce3e0606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:42.326922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-e6b1cd49-ceab-45eb-a495-780ce3e0606a None None] MFA Rules not processed for user `2d4f1dc6686d4bafb95a088c49cb4efa`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:42.328689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e6b1cd49-ceab-45eb-a495-780ce3e0606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:42.520591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9303331-8579-419f-94af-9089da5bd257 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:42.586424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 987/1976] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:42.589496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1cd49-ceab-45eb-a495-780ce3e0606a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:42.689158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9303331-8579-419f-94af-9089da5bd257 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:42.715408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272b57b-88b8-40d2-84e5-92969a97f170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:42.716870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272b57b-88b8-40d2-84e5-92969a97f170 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:42.717579 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272b57b-88b8-40d2-84e5-92969a97f170 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:42.718770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272b57b-88b8-40d2-84e5-92969a97f170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:42.762215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1cd49-ceab-45eb-a495-780ce3e0606a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:42.782443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd86943-d502-4dd1-981f-f04aad0db0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:42.783757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86943-d502-4dd1-981f-f04aad0db0ed admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:42.785976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86943-d502-4dd1-981f-f04aad0db0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:42.786306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86943-d502-4dd1-981f-f04aad0db0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:42.787076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd86943-d502-4dd1-981f-f04aad0db0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:42.792088 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd86943-d502-4dd1-981f-f04aad0db0ed admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:42.871549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 988/1977] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:42 2022] POST /identity/v3/projects => generated 369 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:42.878065 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd86943-d502-4dd1-981f-f04aad0db0ed admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:42.903876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272b57b-88b8-40d2-84e5-92969a97f170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:42.906115 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272b57b-88b8-40d2-84e5-92969a97f170 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:42.943163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 990/1978] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:43.024248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd86943-d502-4dd1-981f-f04aad0db0ed admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:43.036213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ef760-468a-43e7-873d-c3a2f26f6e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:43.040398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef760-468a-43e7-873d-c3a2f26f6e21 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:43.041095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef760-468a-43e7-873d-c3a2f26f6e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:43.041471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ef760-468a-43e7-873d-c3a2f26f6e21 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:43.042775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ef760-468a-43e7-873d-c3a2f26f6e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:43.049252 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ef760-468a-43e7-873d-c3a2f26f6e21 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:43.091371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 989/1979] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:42 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:49:43.096978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272b57b-88b8-40d2-84e5-92969a97f170 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:43.120600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272b57b-88b8-40d2-84e5-92969a97f170 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:43.128420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a064b9-a224-45b6-93fc-d97da98f3f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:43.130042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a064b9-a224-45b6-93fc-d97da98f3f02 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:43.130505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a064b9-a224-45b6-93fc-d97da98f3f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:43.131003 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a064b9-a224-45b6-93fc-d97da98f3f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:43.132512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a064b9-a224-45b6-93fc-d97da98f3f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:43.135781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a064b9-a224-45b6-93fc-d97da98f3f02 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:43.157198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 991/1980] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:43.162243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ef760-468a-43e7-873d-c3a2f26f6e21 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:43.182319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ef760-468a-43e7-873d-c3a2f26f6e21 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:43.194244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec94c-1799-4183-9e66-e9089d11a968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:43.209457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec94c-1799-4183-9e66-e9089d11a968 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:43.209919 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec94c-1799-4183-9e66-e9089d11a968 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:43.210515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec94c-1799-4183-9e66-e9089d11a968 admin admin] PATH_INFO: `/v3/projects/d36b995d67c24a14888437b0ba3ae17e/users/b1104ecf9daa4e27b72620e0e2944291/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:43.281922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ec94c-1799-4183-9e66-e9089d11a968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36b995d67c24a14888437b0ba3ae17e, user_id=b1104ecf9daa4e27b72620e0e2944291, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:43.288199 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ec94c-1799-4183-9e66-e9089d11a968 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:43.336914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 990/1981] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:43 2022] PUT /identity/v3/projects/d36b995d67c24a14888437b0ba3ae17e/users/b1104ecf9daa4e27b72620e0e2944291/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:43.343599 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a064b9-a224-45b6-93fc-d97da98f3f02 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:43.365998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a064b9-a224-45b6-93fc-d97da98f3f02 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:43.496190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070534eb-e40c-431c-8e31-4971a00f15b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:43.497344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070534eb-e40c-431c-8e31-4971a00f15b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:43.497865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070534eb-e40c-431c-8e31-4971a00f15b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:43.500013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070534eb-e40c-431c-8e31-4971a00f15b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:43.502606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070534eb-e40c-431c-8e31-4971a00f15b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:43.507759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070534eb-e40c-431c-8e31-4971a00f15b5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:43.540768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 992/1982] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:49:43.544946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec94c-1799-4183-9e66-e9089d11a968 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:43.578715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec94c-1799-4183-9e66-e9089d11a968 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:43.604659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987c7b2-b1d5-4dc5-b07a-3d9589e30c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:43.615035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987c7b2-b1d5-4dc5-b07a-3d9589e30c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:43.615035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987c7b2-b1d5-4dc5-b07a-3d9589e30c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:43.615035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987c7b2-b1d5-4dc5-b07a-3d9589e30c31 admin admin] PATH_INFO: `/v3/projects/d36b995d67c24a14888437b0ba3ae17e/users/b1104ecf9daa4e27b72620e0e2944291/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:43.627483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987c7b2-b1d5-4dc5-b07a-3d9589e30c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36b995d67c24a14888437b0ba3ae17e, user_id=b1104ecf9daa4e27b72620e0e2944291, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:43.641873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987c7b2-b1d5-4dc5-b07a-3d9589e30c31 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:43.724082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 991/1983] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:43 2022] PUT /identity/v3/projects/d36b995d67c24a14888437b0ba3ae17e/users/b1104ecf9daa4e27b72620e0e2944291/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:43.729549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcd023-cf7d-481a-9215-041db62914a4 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:43.729549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcd023-cf7d-481a-9215-041db62914a4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:43.729549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcd023-cf7d-481a-9215-041db62914a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:43.798780 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-77fcd023-cf7d-481a-9215-041db62914a4 None None] MFA Rules not processed for user `b1104ecf9daa4e27b72620e0e2944291`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:43.802496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-77fcd023-cf7d-481a-9215-041db62914a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:43.983956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 993/1984] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:43.990230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987c7b2-b1d5-4dc5-b07a-3d9589e30c31 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:44.133345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987c7b2-b1d5-4dc5-b07a-3d9589e30c31 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:44.140315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5475f-ab2b-4670-99a1-947222bdb81d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:44.141573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5475f-ab2b-4670-99a1-947222bdb81d service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:44.142101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5475f-ab2b-4670-99a1-947222bdb81d service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:44.142628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5475f-ab2b-4670-99a1-947222bdb81d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:44.164014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5475f-ab2b-4670-99a1-947222bdb81d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:44.167287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5475f-ab2b-4670-99a1-947222bdb81d service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:44.187663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 992/1985] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:44.316957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcd023-cf7d-481a-9215-041db62914a4 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:44.359932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcd023-cf7d-481a-9215-041db62914a4 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:44.377083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c68b28-92d7-4aa5-81a4-27e6bb46af10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:44.379264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c68b28-92d7-4aa5-81a4-27e6bb46af10 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:44.379864 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c68b28-92d7-4aa5-81a4-27e6bb46af10 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:44.380662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c68b28-92d7-4aa5-81a4-27e6bb46af10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:44.509265 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c68b28-92d7-4aa5-81a4-27e6bb46af10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:44.514130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c68b28-92d7-4aa5-81a4-27e6bb46af10 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:44.554687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 994/1986] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:45.010165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c06a07-2c7e-4dc7-bdc0-d595f19a94f6 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:45.010661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c06a07-2c7e-4dc7-bdc0-d595f19a94f6 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:45.011396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c06a07-2c7e-4dc7-bdc0-d595f19a94f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:45.071173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f3c06a07-2c7e-4dc7-bdc0-d595f19a94f6 None None] MFA Rules not processed for user `7730774a21ad488cbcd6ad9e89539fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:45.073395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f3c06a07-2c7e-4dc7-bdc0-d595f19a94f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:45.261067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 993/1987] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:48.985815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c68b28-92d7-4aa5-81a4-27e6bb46af10 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:49.117752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c68b28-92d7-4aa5-81a4-27e6bb46af10 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:49.127114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9c67f-b151-4cd7-9879-17cf971c3198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:49.128763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9c67f-b151-4cd7-9879-17cf971c3198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:49.129662 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9c67f-b151-4cd7-9879-17cf971c3198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:49.130144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9c67f-b151-4cd7-9879-17cf971c3198 admin admin] PATH_INFO: `/v3/users/6e0c8a485e64418b88e0284956b4e330` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:49.132632 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9c67f-b151-4cd7-9879-17cf971c3198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0c8a485e64418b88e0284956b4e330)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:49.136529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9c67f-b151-4cd7-9879-17cf971c3198 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:49.221419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c0b9c67f-b151-4cd7-9879-17cf971c3198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0c8a485e64418b88e0284956b4e330'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:49.246714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c06a07-2c7e-4dc7-bdc0-d595f19a94f6 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:49.247550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c0b9c67f-b151-4cd7-9879-17cf971c3198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0c8a485e64418b88e0284956b4e330'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:49.248756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c0b9c67f-b151-4cd7-9879-17cf971c3198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0c8a485e64418b88e0284956b4e330'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:49.261441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c0b9c67f-b151-4cd7-9879-17cf971c3198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0c8a485e64418b88e0284956b4e330'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:49.269366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c06a07-2c7e-4dc7-bdc0-d595f19a94f6 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:49.271233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c0b9c67f-b151-4cd7-9879-17cf971c3198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0c8a485e64418b88e0284956b4e330'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:49.285922 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 995/1988] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:48 2022] DELETE /identity/v3/users/6e0c8a485e64418b88e0284956b4e330 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:49.286796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9c8c2-08a9-4661-bbc4-359c16fe278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:49.287953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9c8c2-08a9-4661-bbc4-359c16fe278b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:49.288419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9c8c2-08a9-4661-bbc4-359c16fe278b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:49.288876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9c8c2-08a9-4661-bbc4-359c16fe278b admin admin] PATH_INFO: `/v3/users/2d4f1dc6686d4bafb95a088c49cb4efa` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:49.292109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b34a54-116e-49ab-8704-02e27c8722b7 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:49.292573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b34a54-116e-49ab-8704-02e27c8722b7 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:49.292970 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9c8c2-08a9-4661-bbc4-359c16fe278b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4f1dc6686d4bafb95a088c49cb4efa)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:49.293075 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b34a54-116e-49ab-8704-02e27c8722b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:49.295570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9c8c2-08a9-4661-bbc4-359c16fe278b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:49.322779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-56b34a54-116e-49ab-8704-02e27c8722b7 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:49.325038 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-56b34a54-116e-49ab-8704-02e27c8722b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:49.370189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0db9c8c2-08a9-4661-bbc4-359c16fe278b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4f1dc6686d4bafb95a088c49cb4efa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:49.398076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0db9c8c2-08a9-4661-bbc4-359c16fe278b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4f1dc6686d4bafb95a088c49cb4efa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:49.399123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0db9c8c2-08a9-4661-bbc4-359c16fe278b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4f1dc6686d4bafb95a088c49cb4efa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:49.400176 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0db9c8c2-08a9-4661-bbc4-359c16fe278b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4f1dc6686d4bafb95a088c49cb4efa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:49.412508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0db9c8c2-08a9-4661-bbc4-359c16fe278b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4f1dc6686d4bafb95a088c49cb4efa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:49.434649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 994/1989] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:49 2022] DELETE /identity/v3/users/2d4f1dc6686d4bafb95a088c49cb4efa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:49.442331 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 996/1990] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:49.444812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea17493-cbd3-4632-be21-0491dbdb5b80 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:49.445389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea17493-cbd3-4632-be21-0491dbdb5b80 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:49.445972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea17493-cbd3-4632-be21-0491dbdb5b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:49.463398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b34a54-116e-49ab-8704-02e27c8722b7 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:49.466523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-56b34a54-116e-49ab-8704-02e27c8722b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:49.483339 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-9ea17493-cbd3-4632-be21-0491dbdb5b80 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:49.485721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9ea17493-cbd3-4632-be21-0491dbdb5b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:49.603687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b34a54-116e-49ab-8704-02e27c8722b7 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:49.617575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 995/1991] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:49.638968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea17493-cbd3-4632-be21-0491dbdb5b80 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:49.641762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9ea17493-cbd3-4632-be21-0491dbdb5b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:49.756431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb68fe-12f4-4472-9041-b3ac5adc8494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:49.758577 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb68fe-12f4-4472-9041-b3ac5adc8494 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:49.759114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb68fe-12f4-4472-9041-b3ac5adc8494 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:49.760089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb68fe-12f4-4472-9041-b3ac5adc8494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:49.781304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb68fe-12f4-4472-9041-b3ac5adc8494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:49.786582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb68fe-12f4-4472-9041-b3ac5adc8494 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:49.794105 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea17493-cbd3-4632-be21-0491dbdb5b80 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:49.805458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756847f-33a9-4eb8-b496-21f571ec3f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:49.807143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756847f-33a9-4eb8-b496-21f571ec3f0c service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:49.808305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756847f-33a9-4eb8-b496-21f571ec3f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:49.809392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756847f-33a9-4eb8-b496-21f571ec3f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:49.839263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 997/1992] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:49.840331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756847f-33a9-4eb8-b496-21f571ec3f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:49.846597 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756847f-33a9-4eb8-b496-21f571ec3f0c service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:49.869725 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 996/1993] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:50.439186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb68fe-12f4-4472-9041-b3ac5adc8494 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:50.440756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-efbb68fe-12f4-4472-9041-b3ac5adc8494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:50.471240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb68fe-12f4-4472-9041-b3ac5adc8494 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:50.481573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:50.482687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:50.483241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:50.483893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] PATH_INFO: `/v3/projects/ebf4508e126f4f67b9221361f3a2b447` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:50.487163 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf4508e126f4f67b9221361f3a2b447)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:50.492289 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:50.578998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf4508e126f4f67b9221361f3a2b447', 'request_id': 'req-171541e0-6aed-4e03-bde8-38a3b857f5f0'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.588422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf4508e126f4f67b9221361f3a2b447', 'request_id': 'req-171541e0-6aed-4e03-bde8-38a3b857f5f0'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.599634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf4508e126f4f67b9221361f3a2b447', 'request_id': 'req-171541e0-6aed-4e03-bde8-38a3b857f5f0'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.617111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] The token cache is being invalidate because project ebf4508e126f4f67b9221361f3a2b447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:50.617111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.617852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.620070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 998/1994] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:50 2022] DELETE /identity/v3/projects/ebf4508e126f4f67b9221361f3a2b447 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:50.624234 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756847f-33a9-4eb8-b496-21f571ec3f0c service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:50.641139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756847f-33a9-4eb8-b496-21f571ec3f0c service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:50.705267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:50.708699 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:50.742010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:50.743767 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:50.744545 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:50.745713 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] PATH_INFO: `/v3/users/b1104ecf9daa4e27b72620e0e2944291` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:50.747555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1104ecf9daa4e27b72620e0e2944291)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:50.750714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:50.813566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1104ecf9daa4e27b72620e0e2944291'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.826148 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171541e0-6aed-4e03-bde8-38a3b857f5f0 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:50.829744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1104ecf9daa4e27b72620e0e2944291'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.830983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1104ecf9daa4e27b72620e0e2944291'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.832839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1104ecf9daa4e27b72620e0e2944291'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.833533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:50.834542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:50.834931 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:50.835270 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] PATH_INFO: `/v3/projects/affc7dc521c94da3b20e2a9438d1b5bc` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:50.837579 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=affc7dc521c94da3b20e2a9438d1b5bc)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:50.840515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:50.845458 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1104ecf9daa4e27b72620e0e2944291'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.866323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 997/1995] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:50 2022] DELETE /identity/v3/users/b1104ecf9daa4e27b72620e0e2944291 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:50.912800 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affc7dc521c94da3b20e2a9438d1b5bc', 'request_id': 'req-7771ff4e-c6a5-4d83-83b8-92811f9691e1'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.922330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affc7dc521c94da3b20e2a9438d1b5bc', 'request_id': 'req-7771ff4e-c6a5-4d83-83b8-92811f9691e1'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.934203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affc7dc521c94da3b20e2a9438d1b5bc', 'request_id': 'req-7771ff4e-c6a5-4d83-83b8-92811f9691e1'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.949462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] The token cache is being invalidate because project affc7dc521c94da3b20e2a9438d1b5bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:50.950083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.951009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:50.953024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 999/1996] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:50 2022] DELETE /identity/v3/projects/affc7dc521c94da3b20e2a9438d1b5bc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:50.958659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:50.960512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:51.072414 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14cc6e-8ab0-4f31-8b8f-a91cde8a943e admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:51.165806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ca976-ac56-41e7-8089-dbeeb405ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:51.166874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca976-ac56-41e7-8089-dbeeb405ddef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:51.167164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca976-ac56-41e7-8089-dbeeb405ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:51.167441 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca976-ac56-41e7-8089-dbeeb405ddef admin admin] PATH_INFO: `/v3/users/5b55714cd84142cbac58d88fef1a2227` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:51.168726 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ca976-ac56-41e7-8089-dbeeb405ddef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b55714cd84142cbac58d88fef1a2227)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:51.170688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ca976-ac56-41e7-8089-dbeeb405ddef admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:51.235913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-122ca976-ac56-41e7-8089-dbeeb405ddef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b55714cd84142cbac58d88fef1a2227'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:51.255007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-122ca976-ac56-41e7-8089-dbeeb405ddef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b55714cd84142cbac58d88fef1a2227'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:51.255907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-122ca976-ac56-41e7-8089-dbeeb405ddef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b55714cd84142cbac58d88fef1a2227'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:51.256659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-122ca976-ac56-41e7-8089-dbeeb405ddef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b55714cd84142cbac58d88fef1a2227'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:51.266694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-122ca976-ac56-41e7-8089-dbeeb405ddef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b55714cd84142cbac58d88fef1a2227'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:51.288851 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 998/1997] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:50 2022] DELETE /identity/v3/users/5b55714cd84142cbac58d88fef1a2227 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:51.354012 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:51.357704 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:51.381218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771ff4e-c6a5-4d83-83b8-92811f9691e1 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:51.479082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:51.480175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:51.480331 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:51.480603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] PATH_INFO: `/v3/projects/d36b995d67c24a14888437b0ba3ae17e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:51.481896 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36b995d67c24a14888437b0ba3ae17e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:51.483858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:51.543226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36b995d67c24a14888437b0ba3ae17e', 'request_id': 'req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:51.554213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36b995d67c24a14888437b0ba3ae17e', 'request_id': 'req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:51.567594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36b995d67c24a14888437b0ba3ae17e', 'request_id': 'req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:51.591064 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] The token cache is being invalidate because project d36b995d67c24a14888437b0ba3ae17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:51.591384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:51.592442 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9b6b287f-51f3-4e3c-afa9-b612ce3f66ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:51.595315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1000/1998] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:51 2022] DELETE /identity/v3/projects/d36b995d67c24a14888437b0ba3ae17e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:51.604722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212beb5-c464-4bea-a220-a389f4f668fa None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:51.605371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212beb5-c464-4bea-a220-a389f4f668fa None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:51.605715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212beb5-c464-4bea-a220-a389f4f668fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:51.641732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-6212beb5-c464-4bea-a220-a389f4f668fa None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:51.645302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-6212beb5-c464-4bea-a220-a389f4f668fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:51.756129 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 999/1999] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:51.768854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b093b-2f8e-43c9-a218-ec11a8c0ba8d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:51.770118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b093b-2f8e-43c9-a218-ec11a8c0ba8d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:51.771034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b093b-2f8e-43c9-a218-ec11a8c0ba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:51.831012 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2e3b093b-2f8e-43c9-a218-ec11a8c0ba8d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:51.833408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2e3b093b-2f8e-43c9-a218-ec11a8c0ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:51.866018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212beb5-c464-4bea-a220-a389f4f668fa None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:51.868783 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1001/2000] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:51.896508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212beb5-c464-4bea-a220-a389f4f668fa None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:51.907970 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f98b0-7057-4c8a-9b87-2524d128ba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:51.910762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f98b0-7057-4c8a-9b87-2524d128ba69 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:51.911533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f98b0-7057-4c8a-9b87-2524d128ba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:51.912991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f98b0-7057-4c8a-9b87-2524d128ba69 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:51.914609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f98b0-7057-4c8a-9b87-2524d128ba69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:49:51.915121 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f98b0-7057-4c8a-9b87-2524d128ba69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:51.922091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f98b0-7057-4c8a-9b87-2524d128ba69 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:51.953865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1000/2001] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:49:51.959582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b093b-2f8e-43c9-a218-ec11a8c0ba8d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:51.967472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f98b0-7057-4c8a-9b87-2524d128ba69 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:51.971739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b093b-2f8e-43c9-a218-ec11a8c0ba8d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:51.977531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-149f98b0-7057-4c8a-9b87-2524d128ba69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:51.979818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfa76c-ad5c-4665-973d-6df58ea6f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:51.981116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa76c-ad5c-4665-973d-6df58ea6f9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:51.981402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa76c-ad5c-4665-973d-6df58ea6f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:51.981729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfa76c-ad5c-4665-973d-6df58ea6f9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:51.982598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfa76c-ad5c-4665-973d-6df58ea6f9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:51.985300 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfa76c-ad5c-4665-973d-6df58ea6f9b2 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:52.029638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f98b0-7057-4c8a-9b87-2524d128ba69 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:52.040335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1002/2002] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:51 2022] POST /identity/v3/projects => generated 393 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:52.040474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:52.042136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.042649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.043128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] PATH_INFO: `/v3/projects/e2ac2b0545834526a8b2d668e9fca91b` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.045917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ac2b0545834526a8b2d668e9fca91b)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:52.046216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfa76c-ad5c-4665-973d-6df58ea6f9b2 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:52.049975 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:52.111188 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ac2b0545834526a8b2d668e9fca91b', 'request_id': 'req-d4c51351-29ff-4d0a-b0f8-b98c902d845a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:52.119681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ac2b0545834526a8b2d668e9fca91b', 'request_id': 'req-d4c51351-29ff-4d0a-b0f8-b98c902d845a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:52.133599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ac2b0545834526a8b2d668e9fca91b', 'request_id': 'req-d4c51351-29ff-4d0a-b0f8-b98c902d845a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:52.144507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfa76c-ad5c-4665-973d-6df58ea6f9b2 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:52.153411 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] The token cache is being invalidate because project e2ac2b0545834526a8b2d668e9fca91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:52.154163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:52.155182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d4c51351-29ff-4d0a-b0f8-b98c902d845a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:52.158425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1001/2003] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:51 2022] DELETE /identity/v3/projects/e2ac2b0545834526a8b2d668e9fca91b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:52.165783 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f628c7-d4b3-4d8c-b997-9ac35b43c679 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.166244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f628c7-d4b3-4d8c-b997-9ac35b43c679 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.166898 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f628c7-d4b3-4d8c-b997-9ac35b43c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.195854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-e4f628c7-d4b3-4d8c-b997-9ac35b43c679 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:52.197649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e4f628c7-d4b3-4d8c-b997-9ac35b43c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:52.218494 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e649f49-9bf4-49e4-9f4f-a8739b0e7786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:52.219233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e649f49-9bf4-49e4-9f4f-a8739b0e7786 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.219521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e649f49-9bf4-49e4-9f4f-a8739b0e7786 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.220014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e649f49-9bf4-49e4-9f4f-a8739b0e7786 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.221282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e649f49-9bf4-49e4-9f4f-a8739b0e7786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:52.226206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e649f49-9bf4-49e4-9f4f-a8739b0e7786 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:52.270959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1003/2004] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:52 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:49:52.286812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1002/2005] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:52.287652 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e649f49-9bf4-49e4-9f4f-a8739b0e7786 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:52.294277 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-6e649f49-9bf4-49e4-9f4f-a8739b0e7786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:52.300121 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739adda-955f-4012-89e0-dc7b67c6648b None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.300519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739adda-955f-4012-89e0-dc7b67c6648b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.300900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739adda-955f-4012-89e0-dc7b67c6648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.310096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e649f49-9bf4-49e4-9f4f-a8739b0e7786 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:52.317767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16605248-e865-47c7-92c4-6f04fa453d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:52.319089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16605248-e865-47c7-92c4-6f04fa453d03 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.319821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16605248-e865-47c7-92c4-6f04fa453d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.320510 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16605248-e865-47c7-92c4-6f04fa453d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.322101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16605248-e865-47c7-92c4-6f04fa453d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:52.324435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16605248-e865-47c7-92c4-6f04fa453d03 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:52.327440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1739adda-955f-4012-89e0-dc7b67c6648b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:52.328955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1739adda-955f-4012-89e0-dc7b67c6648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:52.340001 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1003/2006] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:52.341410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1004/2007] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:52.345647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739adda-955f-4012-89e0-dc7b67c6648b None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:52.346620 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16605248-e865-47c7-92c4-6f04fa453d03 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:52.367521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16605248-e865-47c7-92c4-6f04fa453d03 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:52.376875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0fd7e-0849-4fff-9a49-7f4a3a77fd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:52.377211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739adda-955f-4012-89e0-dc7b67c6648b None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:52.378854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0fd7e-0849-4fff-9a49-7f4a3a77fd2f admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.379427 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0fd7e-0849-4fff-9a49-7f4a3a77fd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.380047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0fd7e-0849-4fff-9a49-7f4a3a77fd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.381781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0fd7e-0849-4fff-9a49-7f4a3a77fd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:52.386884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0fd7e-0849-4fff-9a49-7f4a3a77fd2f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:52.401574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5f31a-053c-40c2-a55e-1072a1464202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:52.411923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f31a-053c-40c2-a55e-1072a1464202 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.412543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f31a-053c-40c2-a55e-1072a1464202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.413045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5f31a-053c-40c2-a55e-1072a1464202 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.415779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1005/2008] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:52.416418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5f31a-053c-40c2-a55e-1072a1464202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:49:52.417012 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5f31a-053c-40c2-a55e-1072a1464202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:52.421320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0fd7e-0849-4fff-9a49-7f4a3a77fd2f admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:52.424768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5f31a-053c-40c2-a55e-1072a1464202 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:52.446476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1004/2009] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:49:52.447196 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0fd7e-0849-4fff-9a49-7f4a3a77fd2f admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:52.451111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5f31a-053c-40c2-a55e-1072a1464202 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:52.480273 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5f31a-053c-40c2-a55e-1072a1464202 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:52.484047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda107e1-bd42-432e-8f6f-6fb36bcd61a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:52.484972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda107e1-bd42-432e-8f6f-6fb36bcd61a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.485249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda107e1-bd42-432e-8f6f-6fb36bcd61a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.485524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda107e1-bd42-432e-8f6f-6fb36bcd61a8 admin admin] PATH_INFO: `/v3/projects/648e2139ed5b49e2b79857274db3a131/users/e871e78f94c849b2961c7253b487d3aa/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.494197 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a036e-752e-40cb-a441-c8dff28a4fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:52.495915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a036e-752e-40cb-a441-c8dff28a4fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.497102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a036e-752e-40cb-a441-c8dff28a4fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.497881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a036e-752e-40cb-a441-c8dff28a4fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.499757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a036e-752e-40cb-a441-c8dff28a4fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:52.506004 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a036e-752e-40cb-a441-c8dff28a4fd2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:52.514571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda107e1-bd42-432e-8f6f-6fb36bcd61a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648e2139ed5b49e2b79857274db3a131, user_id=e871e78f94c849b2961c7253b487d3aa, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:52.518595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda107e1-bd42-432e-8f6f-6fb36bcd61a8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:52.547897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1006/2010] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:52 2022] PUT /identity/v3/projects/648e2139ed5b49e2b79857274db3a131/users/e871e78f94c849b2961c7253b487d3aa/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:52.563466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65721252-9690-4bf0-b7e3-957c1c712d41 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.564162 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65721252-9690-4bf0-b7e3-957c1c712d41 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.565550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65721252-9690-4bf0-b7e3-957c1c712d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.595105 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1005/2011] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:52 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:49:52.597821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a036e-752e-40cb-a441-c8dff28a4fd2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:52.604973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-65721252-9690-4bf0-b7e3-957c1c712d41 None None] MFA Rules not processed for user `e871e78f94c849b2961c7253b487d3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:52.607841 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-65721252-9690-4bf0-b7e3-957c1c712d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:52.708575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1007/2012] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:52.712156 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65721252-9690-4bf0-b7e3-957c1c712d41 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:52.774666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a036e-752e-40cb-a441-c8dff28a4fd2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:52.785929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066031-066d-4546-a5cd-9a659fd08964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:52.788385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066031-066d-4546-a5cd-9a659fd08964 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.789027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066031-066d-4546-a5cd-9a659fd08964 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.789847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066031-066d-4546-a5cd-9a659fd08964 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.792386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3066031-066d-4546-a5cd-9a659fd08964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:52.817461 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3066031-066d-4546-a5cd-9a659fd08964 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:52.875011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1006/2013] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:52 2022] POST /identity/v3/users => generated 292 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:52.880114 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066031-066d-4546-a5cd-9a659fd08964 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:52.880783 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65721252-9690-4bf0-b7e3-957c1c712d41 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:52.892922 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573e5d-d016-4a56-bcb5-cc415d2ad1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:52.893608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573e5d-d016-4a56-bcb5-cc415d2ad1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.894437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066031-066d-4546-a5cd-9a659fd08964 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:52.894550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573e5d-d016-4a56-bcb5-cc415d2ad1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.894832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573e5d-d016-4a56-bcb5-cc415d2ad1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.895546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a573e5d-d016-4a56-bcb5-cc415d2ad1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:52.897591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a573e5d-d016-4a56-bcb5-cc415d2ad1e1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:52.913114 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97eb77d-b4b3-4125-999f-341b4244bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:52.914182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eb77d-b4b3-4125-999f-341b4244bdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:52.914182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eb77d-b4b3-4125-999f-341b4244bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:52.914629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eb77d-b4b3-4125-999f-341b4244bdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:52.915454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97eb77d-b4b3-4125-999f-341b4244bdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:52.917208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97eb77d-b4b3-4125-999f-341b4244bdb5 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:52.970944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1008/2014] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:52 2022] POST /identity/v3/projects => generated 391 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:52.974859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1007/2015] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:52.978824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573e5d-d016-4a56-bcb5-cc415d2ad1e1 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:52.979014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97eb77d-b4b3-4125-999f-341b4244bdb5 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:52.991614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97eb77d-b4b3-4125-999f-341b4244bdb5 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:53.080008 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0d85d-44c5-48e1-af12-1e021e792a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:53.084750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0d85d-44c5-48e1-af12-1e021e792a91 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:53.085029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0d85d-44c5-48e1-af12-1e021e792a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:53.085302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0d85d-44c5-48e1-af12-1e021e792a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:53.088391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0d85d-44c5-48e1-af12-1e021e792a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:53.091994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0d85d-44c5-48e1-af12-1e021e792a91 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:53.110702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573e5d-d016-4a56-bcb5-cc415d2ad1e1 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:53.119308 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1008/2016] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:53.119308 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0d85d-44c5-48e1-af12-1e021e792a91 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:53.119755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2cb0d85d-44c5-48e1-af12-1e021e792a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:53.122588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb423f-b9df-4dc7-8106-671938d6fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:53.123944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb423f-b9df-4dc7-8106-671938d6fd16 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:53.124524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb423f-b9df-4dc7-8106-671938d6fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:53.125083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb423f-b9df-4dc7-8106-671938d6fd16 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:53.126425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb423f-b9df-4dc7-8106-671938d6fd16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:53.131554 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb423f-b9df-4dc7-8106-671938d6fd16 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:53.134376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0d85d-44c5-48e1-af12-1e021e792a91 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:53.139046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b86ea-b97e-4266-a66b-55c63163f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:53.141359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b86ea-b97e-4266-a66b-55c63163f0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:53.141650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b86ea-b97e-4266-a66b-55c63163f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:53.141929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b86ea-b97e-4266-a66b-55c63163f0a9 admin admin] PATH_INFO: `/v3/users/faa8b36110914c54a1b304db2bdffd34` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:53.143675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b86ea-b97e-4266-a66b-55c63163f0a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa8b36110914c54a1b304db2bdffd34)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:53.145673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b86ea-b97e-4266-a66b-55c63163f0a9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:53.172336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1009/2017] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:52 2022] POST /identity/v3/users => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:53.172336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb423f-b9df-4dc7-8106-671938d6fd16 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:53.184921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb423f-b9df-4dc7-8106-671938d6fd16 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:53.194288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dd730-f148-412d-89eb-d6d3778522a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:53.197847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd730-f148-412d-89eb-d6d3778522a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:53.198317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd730-f148-412d-89eb-d6d3778522a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:53.198757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd730-f148-412d-89eb-d6d3778522a8 admin admin] PATH_INFO: `/v3/projects/9be36a3ed343451295039adbb88d7df0/users/81c07f419cd344cab511d20f2607de81/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:53.209531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-e73b86ea-b97e-4266-a66b-55c63163f0a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa8b36110914c54a1b304db2bdffd34'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:53.226973 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-e73b86ea-b97e-4266-a66b-55c63163f0a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa8b36110914c54a1b304db2bdffd34'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:53.228142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-e73b86ea-b97e-4266-a66b-55c63163f0a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa8b36110914c54a1b304db2bdffd34'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:53.229233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-e73b86ea-b97e-4266-a66b-55c63163f0a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa8b36110914c54a1b304db2bdffd34'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:53.230213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dd730-f148-412d-89eb-d6d3778522a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be36a3ed343451295039adbb88d7df0, user_id=81c07f419cd344cab511d20f2607de81, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:53.235193 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dd730-f148-412d-89eb-d6d3778522a8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:53.247406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-e73b86ea-b97e-4266-a66b-55c63163f0a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa8b36110914c54a1b304db2bdffd34'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:53.260212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1010/2018] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:53 2022] PUT /identity/v3/projects/9be36a3ed343451295039adbb88d7df0/users/81c07f419cd344cab511d20f2607de81/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:53.261807 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dd730-f148-412d-89eb-d6d3778522a8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:53.280999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3f3dd730-f148-412d-89eb-d6d3778522a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:53.281192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1009/2019] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:53 2022] DELETE /identity/v3/users/faa8b36110914c54a1b304db2bdffd34 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:53.283678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8765005-0727-4d01-8c8f-e0810f63f131 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:53.284229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8765005-0727-4d01-8c8f-e0810f63f131 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:53.285320 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8765005-0727-4d01-8c8f-e0810f63f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:53.320709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d8765005-0727-4d01-8c8f-e0810f63f131 None None] MFA Rules not processed for user `81c07f419cd344cab511d20f2607de81`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:53.322174 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d8765005-0727-4d01-8c8f-e0810f63f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:53.379972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dd730-f148-412d-89eb-d6d3778522a8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:53.427847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1010/2020] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:53.429494 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507d634-634f-4423-baca-e9464d2990a0 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:53.429974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507d634-634f-4423-baca-e9464d2990a0 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:53.430441 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507d634-634f-4423-baca-e9464d2990a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:53.453029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-7507d634-634f-4423-baca-e9464d2990a0 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:53.454410 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7507d634-634f-4423-baca-e9464d2990a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:53.474481 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a60ea-aac8-43c5-9af4-2f40526c73c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:53.475345 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a60ea-aac8-43c5-9af4-2f40526c73c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:53.475767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a60ea-aac8-43c5-9af4-2f40526c73c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:53.476299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a60ea-aac8-43c5-9af4-2f40526c73c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:53.477036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a60ea-aac8-43c5-9af4-2f40526c73c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:53.479250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a60ea-aac8-43c5-9af4-2f40526c73c1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:53.491905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1011/2021] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:53.492753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a60ea-aac8-43c5-9af4-2f40526c73c1 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:53.501628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4f0a60ea-aac8-43c5-9af4-2f40526c73c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:53.515013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a60ea-aac8-43c5-9af4-2f40526c73c1 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:53.521960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01d006-55d3-40f7-bbb9-6e032a6c2a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:53.522891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01d006-55d3-40f7-bbb9-6e032a6c2a9e admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:53.523609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01d006-55d3-40f7-bbb9-6e032a6c2a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:53.523921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01d006-55d3-40f7-bbb9-6e032a6c2a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:53.525014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01d006-55d3-40f7-bbb9-6e032a6c2a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:53.526831 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01d006-55d3-40f7-bbb9-6e032a6c2a9e admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:53.580248 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1012/2022] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:53 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:53.582083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1011/2023] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:53.583306 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01d006-55d3-40f7-bbb9-6e032a6c2a9e admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:53.585464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507d634-634f-4423-baca-e9464d2990a0 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:53.587077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7507d634-634f-4423-baca-e9464d2990a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:53.688417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01d006-55d3-40f7-bbb9-6e032a6c2a9e admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:53.692285 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507d634-634f-4423-baca-e9464d2990a0 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:53.696578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77add0b-4fc6-4575-8fef-88ffc57fca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:53.697937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77add0b-4fc6-4575-8fef-88ffc57fca53 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:53.699171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77add0b-4fc6-4575-8fef-88ffc57fca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:53.699171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77add0b-4fc6-4575-8fef-88ffc57fca53 admin admin] PATH_INFO: `/v3/projects/448498b2362346feba74e7e682920675/users/bd467f7bbd044ddc81ec8707738b250e/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:53.728470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77add0b-4fc6-4575-8fef-88ffc57fca53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448498b2362346feba74e7e682920675, user_id=bd467f7bbd044ddc81ec8707738b250e, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:53.731423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77add0b-4fc6-4575-8fef-88ffc57fca53 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:53.771899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1013/2024] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:53 2022] PUT /identity/v3/projects/448498b2362346feba74e7e682920675/users/bd467f7bbd044ddc81ec8707738b250e/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:53.774345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6f35-6c0f-489c-b83f-2dfb4394ebee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:53.775483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6f35-6c0f-489c-b83f-2dfb4394ebee service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:53.776082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77add0b-4fc6-4575-8fef-88ffc57fca53 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:53.776164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6f35-6c0f-489c-b83f-2dfb4394ebee service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:53.776538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6f35-6c0f-489c-b83f-2dfb4394ebee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:53.797149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf6f35-6c0f-489c-b83f-2dfb4394ebee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:53.799654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf6f35-6c0f-489c-b83f-2dfb4394ebee service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:53.822645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1012/2025] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:49:53.823528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6f35-6c0f-489c-b83f-2dfb4394ebee service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:53.837661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6f35-6c0f-489c-b83f-2dfb4394ebee service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:53.903976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77add0b-4fc6-4575-8fef-88ffc57fca53 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:53.917542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b88e1e-0a6f-450b-9e40-4f494c92fba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:53.923119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88e1e-0a6f-450b-9e40-4f494c92fba4 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:53.923787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88e1e-0a6f-450b-9e40-4f494c92fba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:53.924353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88e1e-0a6f-450b-9e40-4f494c92fba4 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:53.925969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b88e1e-0a6f-450b-9e40-4f494c92fba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:53.947475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b88e1e-0a6f-450b-9e40-4f494c92fba4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:54.003019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9324540-8b3f-489a-812b-e404e90e99a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:54.004703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9324540-8b3f-489a-812b-e404e90e99a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:54.005472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1014/2026] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:53 2022] POST /identity/v3/users => generated 299 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:54.011973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b88e1e-0a6f-450b-9e40-4f494c92fba4 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:54.013773 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9324540-8b3f-489a-812b-e404e90e99a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:54.016151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9324540-8b3f-489a-812b-e404e90e99a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:54.016944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9324540-8b3f-489a-812b-e404e90e99a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:54.025710 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9324540-8b3f-489a-812b-e404e90e99a7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:54.047729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1013/2027] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:54.054007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9324540-8b3f-489a-812b-e404e90e99a7 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:54.063335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b88e1e-0a6f-450b-9e40-4f494c92fba4 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:54.069575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9324540-8b3f-489a-812b-e404e90e99a7 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:54.077602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865e99b-3751-4215-bd11-1923d23a0d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:54.079096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865e99b-3751-4215-bd11-1923d23a0d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:54.079666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865e99b-3751-4215-bd11-1923d23a0d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:54.080205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865e99b-3751-4215-bd11-1923d23a0d8a admin admin] PATH_INFO: `/v3/projects/448498b2362346feba74e7e682920675/users/bd467f7bbd044ddc81ec8707738b250e/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:54.084697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865e99b-3751-4215-bd11-1923d23a0d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=448498b2362346feba74e7e682920675, user_id=bd467f7bbd044ddc81ec8707738b250e, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:54.084890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffc798-7222-43ac-8ab9-428b80e146f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:54.086042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffc798-7222-43ac-8ab9-428b80e146f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:54.086541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffc798-7222-43ac-8ab9-428b80e146f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:54.087042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffc798-7222-43ac-8ab9-428b80e146f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:54.090403 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865e99b-3751-4215-bd11-1923d23a0d8a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:54.091072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffc798-7222-43ac-8ab9-428b80e146f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:54.102602 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffc798-7222-43ac-8ab9-428b80e146f5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:54.117792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1014/2028] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:54 2022] PUT /identity/v3/projects/448498b2362346feba74e7e682920675/users/bd467f7bbd044ddc81ec8707738b250e/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:54.120185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac021a64-8556-4a20-a0ee-fe547bd8fd8a None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:54.120877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac021a64-8556-4a20-a0ee-fe547bd8fd8a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:54.121165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac021a64-8556-4a20-a0ee-fe547bd8fd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:54.132435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1015/2029] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:54.141174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffc798-7222-43ac-8ab9-428b80e146f5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:54.166983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-ac021a64-8556-4a20-a0ee-fe547bd8fd8a None None] MFA Rules not processed for user `bd467f7bbd044ddc81ec8707738b250e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:54.169440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ac021a64-8556-4a20-a0ee-fe547bd8fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:54.179503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffc798-7222-43ac-8ab9-428b80e146f5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:54.302792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1015/2030] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:54.325967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac021a64-8556-4a20-a0ee-fe547bd8fd8a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:54.328246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ac021a64-8556-4a20-a0ee-fe547bd8fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:54.351477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51e48a-2335-4dcd-bbcf-a1e8fd42ee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:54.353609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51e48a-2335-4dcd-bbcf-a1e8fd42ee35 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:54.354275 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51e48a-2335-4dcd-bbcf-a1e8fd42ee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:54.354572 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51e48a-2335-4dcd-bbcf-a1e8fd42ee35 admin admin] PATH_INFO: `/v3/projects/0f3d548518624e9dbf8bc2efb86c7cec/users/5240133b698c4cec973a7f737b65ff7d/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:54.389804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51e48a-2335-4dcd-bbcf-a1e8fd42ee35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3d548518624e9dbf8bc2efb86c7cec, user_id=5240133b698c4cec973a7f737b65ff7d, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:54.393546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51e48a-2335-4dcd-bbcf-a1e8fd42ee35 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:54.438884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1016/2031] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:54 2022] PUT /identity/v3/projects/0f3d548518624e9dbf8bc2efb86c7cec/users/5240133b698c4cec973a7f737b65ff7d/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:54.444274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51e48a-2335-4dcd-bbcf-a1e8fd42ee35 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:54.451452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac021a64-8556-4a20-a0ee-fe547bd8fd8a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:54.541393 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6910e-3563-4473-b246-0dcea3f834d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:54.542642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6910e-3563-4473-b246-0dcea3f834d1 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:54.543009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6910e-3563-4473-b246-0dcea3f834d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:54.543369 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6910e-3563-4473-b246-0dcea3f834d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:54.553591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51e48a-2335-4dcd-bbcf-a1e8fd42ee35 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:54.561951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9a16f-c814-4fc5-9125-1ebcc917ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:54.563061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9a16f-c814-4fc5-9125-1ebcc917ce4c admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:54.563495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9a16f-c814-4fc5-9125-1ebcc917ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:54.563954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9a16f-c814-4fc5-9125-1ebcc917ce4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:54.565018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9a16f-c814-4fc5-9125-1ebcc917ce4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:54.567252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9a16f-c814-4fc5-9125-1ebcc917ce4c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:54.584108 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1017/2032] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:54.585349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9a16f-c814-4fc5-9125-1ebcc917ce4c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:54.587344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-42c9a16f-c814-4fc5-9125-1ebcc917ce4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:54.603396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9a16f-c814-4fc5-9125-1ebcc917ce4c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:54.611180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:54.612452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:54.613111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:54.613880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] PATH_INFO: `/v3/projects/e80dad8edbc648748a6f605081dcee6e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:54.616644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80dad8edbc648748a6f605081dcee6e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:54.623048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:54.655034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6910e-3563-4473-b246-0dcea3f834d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:54.657449 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6910e-3563-4473-b246-0dcea3f834d1 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:54.674660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1016/2033] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:54.676465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6910e-3563-4473-b246-0dcea3f834d1 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:54.697411 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6910e-3563-4473-b246-0dcea3f834d1 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:54.736196 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80dad8edbc648748a6f605081dcee6e', 'request_id': 'req-abed99c5-a6aa-4048-a982-779d1f14aa3a'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:54.747674 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80dad8edbc648748a6f605081dcee6e', 'request_id': 'req-abed99c5-a6aa-4048-a982-779d1f14aa3a'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:54.765245 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80dad8edbc648748a6f605081dcee6e', 'request_id': 'req-abed99c5-a6aa-4048-a982-779d1f14aa3a'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:54.779637 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] The token cache is being invalidate because project e80dad8edbc648748a6f605081dcee6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:54.780326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:54.782078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:54.785158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1018/2034] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:54 2022] DELETE /identity/v3/projects/e80dad8edbc648748a6f605081dcee6e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:54.786473 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:54.788237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:54.830625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dc9f4-ac89-495c-8216-657b0965452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:54.833097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc9f4-ac89-495c-8216-657b0965452c admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:54.833097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc9f4-ac89-495c-8216-657b0965452c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:54.833097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc9f4-ac89-495c-8216-657b0965452c admin admin] PATH_INFO: `/v3/projects/0f3d548518624e9dbf8bc2efb86c7cec/users/5240133b698c4cec973a7f737b65ff7d/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:54.834999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dc9f4-ac89-495c-8216-657b0965452c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3d548518624e9dbf8bc2efb86c7cec, user_id=5240133b698c4cec973a7f737b65ff7d, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:54.837090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dc9f4-ac89-495c-8216-657b0965452c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:54.864964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1017/2035] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:54 2022] PUT /identity/v3/projects/0f3d548518624e9dbf8bc2efb86c7cec/users/5240133b698c4cec973a7f737b65ff7d/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:54.864964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dc9f4-ac89-495c-8216-657b0965452c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:54.864964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-433dc9f4-ac89-495c-8216-657b0965452c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:54.917369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed99c5-a6aa-4048-a982-779d1f14aa3a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:54.977291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dc9f4-ac89-495c-8216-657b0965452c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:54.999527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:55.009926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:55.013885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58bc8a-8da0-46bf-886c-335442e4e108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:55.014171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:55.014330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58bc8a-8da0-46bf-886c-335442e4e108 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:55.014330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58bc8a-8da0-46bf-886c-335442e4e108 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:55.014589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] PATH_INFO: `/v3/users/47d5e09dc5154ad992a325419bcc319e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:55.014727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58bc8a-8da0-46bf-886c-335442e4e108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:55.016987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0d58bc8a-8da0-46bf-886c-335442e4e108 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:55.027943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d5e09dc5154ad992a325419bcc319e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:55.030092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:55.117360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d5e09dc5154ad992a325419bcc319e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:55.148671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d5e09dc5154ad992a325419bcc319e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:55.149625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d5e09dc5154ad992a325419bcc319e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:55.150671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d5e09dc5154ad992a325419bcc319e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:55.163485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d5e09dc5154ad992a325419bcc319e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:55.171227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58bc8a-8da0-46bf-886c-335442e4e108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:55.174394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58bc8a-8da0-46bf-886c-335442e4e108 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:55.195094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1019/2036] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:55.197468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58fb70-8709-4dca-a986-49afba6532ed None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:55.198206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58fb70-8709-4dca-a986-49afba6532ed None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:55.198953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58fb70-8709-4dca-a986-49afba6532ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:55.233133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1018/2037] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:54 2022] DELETE /identity/v3/users/47d5e09dc5154ad992a325419bcc319e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:55.273608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-3c58fb70-8709-4dca-a986-49afba6532ed None None] MFA Rules not processed for user `5240133b698c4cec973a7f737b65ff7d`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:55.275989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3c58fb70-8709-4dca-a986-49afba6532ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:55.428376 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1020/2038] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:55.442283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:55.446930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:55.584294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b3bab-1d82-4e47-957d-fe98fa9a991e admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:55.589678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1113c3d-3c39-4b5d-a59d-f8544a2d409d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:55.591520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1113c3d-3c39-4b5d-a59d-f8544a2d409d service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:55.591963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1113c3d-3c39-4b5d-a59d-f8544a2d409d service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:55.592310 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1113c3d-3c39-4b5d-a59d-f8544a2d409d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:55.594596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d1113c3d-3c39-4b5d-a59d-f8544a2d409d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:55.705050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1113c3d-3c39-4b5d-a59d-f8544a2d409d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:55.709173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1113c3d-3c39-4b5d-a59d-f8544a2d409d service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:55.733815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1019/2039] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:55.981347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58fb70-8709-4dca-a986-49afba6532ed None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:55.983250 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3c58fb70-8709-4dca-a986-49afba6532ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:56.123763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58fb70-8709-4dca-a986-49afba6532ed None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:56.131487 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:56.132427 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:56.132735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:56.132979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] PATH_INFO: `/v3/projects/a324b31806874672800e9f51b16f1c6c` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:56.134479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a324b31806874672800e9f51b16f1c6c)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:56.136760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:56.247482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a324b31806874672800e9f51b16f1c6c', 'request_id': 'req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:56.264825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a324b31806874672800e9f51b16f1c6c', 'request_id': 'req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:56.280185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a324b31806874672800e9f51b16f1c6c', 'request_id': 'req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:56.309437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] The token cache is being invalidate because project a324b31806874672800e9f51b16f1c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:56.309999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:56.311177 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fc4fdcfb-8896-4c30-bbeb-34f7aa13eb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:56.316383 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1021/2040] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:55 2022] DELETE /identity/v3/projects/a324b31806874672800e9f51b16f1c6c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:56.321739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8a52f-9ce4-4905-86d7-841f113509b2 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:56.323534 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8a52f-9ce4-4905-86d7-841f113509b2 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:56.323804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8a52f-9ce4-4905-86d7-841f113509b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:56.374273 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d1d8a52f-9ce4-4905-86d7-841f113509b2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:56.376550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d1d8a52f-9ce4-4905-86d7-841f113509b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:56.475516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1020/2041] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:56.484532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa3e94-bcba-4a70-bb69-1dedcc159f96 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:56.484904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa3e94-bcba-4a70-bb69-1dedcc159f96 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:56.485249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa3e94-bcba-4a70-bb69-1dedcc159f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:56.507643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8cfa3e94-bcba-4a70-bb69-1dedcc159f96 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:56.509411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8cfa3e94-bcba-4a70-bb69-1dedcc159f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:56.526815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1022/2042] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:56.528349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8a52f-9ce4-4905-86d7-841f113509b2 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:56.541258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8a52f-9ce4-4905-86d7-841f113509b2 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:56.548336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a97660-871a-42f5-aecc-b6e9233d6fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:56.549030 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a97660-871a-42f5-aecc-b6e9233d6fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:56.549312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a97660-871a-42f5-aecc-b6e9233d6fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:56.549613 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a97660-871a-42f5-aecc-b6e9233d6fb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:56.551018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a97660-871a-42f5-aecc-b6e9233d6fb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:49:56.551499 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a97660-871a-42f5-aecc-b6e9233d6fb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:56.553883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a97660-871a-42f5-aecc-b6e9233d6fb1 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:56.573791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1021/2043] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:49:56.578916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa3e94-bcba-4a70-bb69-1dedcc159f96 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:56.592408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa3e94-bcba-4a70-bb69-1dedcc159f96 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:56.599549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e67f-0b36-464c-9b7f-7fdc4c16e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:56.600373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e67f-0b36-464c-9b7f-7fdc4c16e47f admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:56.600738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e67f-0b36-464c-9b7f-7fdc4c16e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:56.601188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e67f-0b36-464c-9b7f-7fdc4c16e47f admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:56.602059 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60e67f-0b36-464c-9b7f-7fdc4c16e47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:56.604479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60e67f-0b36-464c-9b7f-7fdc4c16e47f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:56.644629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1023/2044] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:56 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:56.651624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a97660-871a-42f5-aecc-b6e9233d6fb1 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:56.669304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a97660-871a-42f5-aecc-b6e9233d6fb1 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:56.747327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1aaadc-bdd3-4f47-9d18-62f9adbac2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:56.748050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aaadc-bdd3-4f47-9d18-62f9adbac2be admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:56.748336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aaadc-bdd3-4f47-9d18-62f9adbac2be admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:56.748661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aaadc-bdd3-4f47-9d18-62f9adbac2be admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:56.749513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1aaadc-bdd3-4f47-9d18-62f9adbac2be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:56.751448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1aaadc-bdd3-4f47-9d18-62f9adbac2be admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:56.782000 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1022/2045] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:56 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:56.787165 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e67f-0b36-464c-9b7f-7fdc4c16e47f admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:56.802789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e67f-0b36-464c-9b7f-7fdc4c16e47f admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:56.810749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd96b3c-2708-4fa1-929a-155dd295af3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:56.811979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96b3c-2708-4fa1-929a-155dd295af3d admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:56.812469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96b3c-2708-4fa1-929a-155dd295af3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:56.812954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96b3c-2708-4fa1-929a-155dd295af3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:56.814395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd96b3c-2708-4fa1-929a-155dd295af3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:56.817715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd96b3c-2708-4fa1-929a-155dd295af3d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:56.839141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1024/2046] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:56.844522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1aaadc-bdd3-4f47-9d18-62f9adbac2be admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:56.860388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1aaadc-bdd3-4f47-9d18-62f9adbac2be admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:56.866831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da4f17-de0b-4f76-a09d-d5b2ed178104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:56.867740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da4f17-de0b-4f76-a09d-d5b2ed178104 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:56.867964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da4f17-de0b-4f76-a09d-d5b2ed178104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:56.868266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da4f17-de0b-4f76-a09d-d5b2ed178104 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:56.869028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da4f17-de0b-4f76-a09d-d5b2ed178104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:56.870732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da4f17-de0b-4f76-a09d-d5b2ed178104 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:56.882855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1023/2047] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:56.887025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd96b3c-2708-4fa1-929a-155dd295af3d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:56.899140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd96b3c-2708-4fa1-929a-155dd295af3d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:56.904222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c6fcf-4788-4e5a-8c42-3c8ec57d9ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:56.905122 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c6fcf-4788-4e5a-8c42-3c8ec57d9ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:56.905420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c6fcf-4788-4e5a-8c42-3c8ec57d9ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:56.905698 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c6fcf-4788-4e5a-8c42-3c8ec57d9ae0 admin admin] PATH_INFO: `/v3/projects/1087d7406b5e4518abb1c2645811bd4d/users/bbe6984f3cbe4c5385797618c09a1d7e/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:56.936527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c6fcf-4788-4e5a-8c42-3c8ec57d9ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1087d7406b5e4518abb1c2645811bd4d, user_id=bbe6984f3cbe4c5385797618c09a1d7e, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:56.943467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c6fcf-4788-4e5a-8c42-3c8ec57d9ae0 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:56.966396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1025/2048] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:56 2022] PUT /identity/v3/projects/1087d7406b5e4518abb1c2645811bd4d/users/bbe6984f3cbe4c5385797618c09a1d7e/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:56.986433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c0168-08e9-4ab9-aef1-2533af8a344c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:56.986988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c0168-08e9-4ab9-aef1-2533af8a344c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:56.988180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c0168-08e9-4ab9-aef1-2533af8a344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:57.045961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-e35c0168-08e9-4ab9-aef1-2533af8a344c None None] MFA Rules not processed for user `bbe6984f3cbe4c5385797618c09a1d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:57.048517 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e35c0168-08e9-4ab9-aef1-2533af8a344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:57.138079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1024/2049] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:57.144128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c6fcf-4788-4e5a-8c42-3c8ec57d9ae0 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:57.229535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c6fcf-4788-4e5a-8c42-3c8ec57d9ae0 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:57.237056 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d38bcb-5b93-4e8a-819f-49d31fef9aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:57.238420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d38bcb-5b93-4e8a-819f-49d31fef9aba admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:57.238818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d38bcb-5b93-4e8a-819f-49d31fef9aba admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:57.239258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d38bcb-5b93-4e8a-819f-49d31fef9aba admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:57.239932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d38bcb-5b93-4e8a-819f-49d31fef9aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:57.242083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d38bcb-5b93-4e8a-819f-49d31fef9aba admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:57.277835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1026/2050] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:57 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:57.282239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c0168-08e9-4ab9-aef1-2533af8a344c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:57.294737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c0168-08e9-4ab9-aef1-2533af8a344c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:57.368208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a0f1f-42bf-44aa-b376-02d69b3bace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:57.369168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a0f1f-42bf-44aa-b376-02d69b3bace9 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:57.369435 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a0f1f-42bf-44aa-b376-02d69b3bace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:57.369903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a0f1f-42bf-44aa-b376-02d69b3bace9 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:57.370762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a0f1f-42bf-44aa-b376-02d69b3bace9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:57.372984 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a0f1f-42bf-44aa-b376-02d69b3bace9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:57.407091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1025/2051] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:57 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:57.413099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d38bcb-5b93-4e8a-819f-49d31fef9aba admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:57.424895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d38bcb-5b93-4e8a-819f-49d31fef9aba admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:57.430835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc2b96-4541-4ec1-b0d4-262392278e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:57.432119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc2b96-4541-4ec1-b0d4-262392278e60 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:57.432597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc2b96-4541-4ec1-b0d4-262392278e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:57.433079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc2b96-4541-4ec1-b0d4-262392278e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:57.433934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc2b96-4541-4ec1-b0d4-262392278e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:57.435689 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc2b96-4541-4ec1-b0d4-262392278e60 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:57.447788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1027/2052] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:57.452733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a0f1f-42bf-44aa-b376-02d69b3bace9 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:57.475631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a0f1f-42bf-44aa-b376-02d69b3bace9 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:57.482896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0617659-3db1-479f-8c18-ddd7e9e5c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:57.483936 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617659-3db1-479f-8c18-ddd7e9e5c2be admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:57.484144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617659-3db1-479f-8c18-ddd7e9e5c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:57.484423 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617659-3db1-479f-8c18-ddd7e9e5c2be admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:57.485167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0617659-3db1-479f-8c18-ddd7e9e5c2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:57.487177 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0617659-3db1-479f-8c18-ddd7e9e5c2be admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:57.498556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1026/2053] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:57.503457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc2b96-4541-4ec1-b0d4-262392278e60 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:57.514175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc2b96-4541-4ec1-b0d4-262392278e60 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:57.522512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0def161-9f79-4677-9ece-03891a8bcb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:57.523564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0def161-9f79-4677-9ece-03891a8bcb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:57.524100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0def161-9f79-4677-9ece-03891a8bcb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:57.524445 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0def161-9f79-4677-9ece-03891a8bcb69 admin admin] PATH_INFO: `/v3/projects/e0f7570ea0444dfaade6618479165fd4/users/549ac177ddda4b59ac6b53f601eee637/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:57.542583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0def161-9f79-4677-9ece-03891a8bcb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f7570ea0444dfaade6618479165fd4, user_id=549ac177ddda4b59ac6b53f601eee637, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:57.545499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0def161-9f79-4677-9ece-03891a8bcb69 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:57.578861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1028/2054] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:57 2022] PUT /identity/v3/projects/e0f7570ea0444dfaade6618479165fd4/users/549ac177ddda4b59ac6b53f601eee637/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:57.590853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd998be-1007-4d61-9ad8-fe8cfb64ab73 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:57.591990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd998be-1007-4d61-9ad8-fe8cfb64ab73 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:57.592276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd998be-1007-4d61-9ad8-fe8cfb64ab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:57.632069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-9fd998be-1007-4d61-9ad8-fe8cfb64ab73 None None] MFA Rules not processed for user `549ac177ddda4b59ac6b53f601eee637`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:57.634276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9fd998be-1007-4d61-9ad8-fe8cfb64ab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:57.738073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0def161-9f79-4677-9ece-03891a8bcb69 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:57.740182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1027/2055] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:49:57.836911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0def161-9f79-4677-9ece-03891a8bcb69 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:57.846253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2c52d-3b7d-43c3-b6a0-d6741f78ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:57.848046 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c52d-3b7d-43c3-b6a0-d6741f78ab9c admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:57.848397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c52d-3b7d-43c3-b6a0-d6741f78ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:57.848721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2c52d-3b7d-43c3-b6a0-d6741f78ab9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:57.849837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2c52d-3b7d-43c3-b6a0-d6741f78ab9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:57.853885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2c52d-3b7d-43c3-b6a0-d6741f78ab9c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:57.939460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1029/2056] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:49:57 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:57.948517 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd998be-1007-4d61-9ad8-fe8cfb64ab73 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:57.962356 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd998be-1007-4d61-9ad8-fe8cfb64ab73 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:58.140318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940233a-823e-4644-81ac-4e0d093f27cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:58.141113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940233a-823e-4644-81ac-4e0d093f27cd admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:58.141471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940233a-823e-4644-81ac-4e0d093f27cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:58.141806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940233a-823e-4644-81ac-4e0d093f27cd admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:58.142949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940233a-823e-4644-81ac-4e0d093f27cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:58.146823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940233a-823e-4644-81ac-4e0d093f27cd admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:58.210655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1028/2057] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:49:57 2022] POST /identity/v3/users => generated 299 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:49:58.212079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2c52d-3b7d-43c3-b6a0-d6741f78ab9c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:58.231730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2c52d-3b7d-43c3-b6a0-d6741f78ab9c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:58.246352 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0c8f9-639f-4904-9a68-eb0803ee2714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:58.247400 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0c8f9-639f-4904-9a68-eb0803ee2714 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:58.247927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0c8f9-639f-4904-9a68-eb0803ee2714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:58.248608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0c8f9-639f-4904-9a68-eb0803ee2714 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:58.249641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0c8f9-639f-4904-9a68-eb0803ee2714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:58.251753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0c8f9-639f-4904-9a68-eb0803ee2714 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:58.268276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1030/2058] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:58.274348 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940233a-823e-4644-81ac-4e0d093f27cd admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:58.285980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940233a-823e-4644-81ac-4e0d093f27cd admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:58.291999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616fe57-ff96-43a9-8a28-b3db43f7d094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:58.293227 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fe57-ff96-43a9-8a28-b3db43f7d094 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:58.293746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fe57-ff96-43a9-8a28-b3db43f7d094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:58.294228 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fe57-ff96-43a9-8a28-b3db43f7d094 admin admin] PATH_INFO: `/v3/projects/414cd8578be24455b2823c5c6748c67c/users/ce40c3d4281d47c388dac490776efad1/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:58.312741 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616fe57-ff96-43a9-8a28-b3db43f7d094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414cd8578be24455b2823c5c6748c67c, user_id=ce40c3d4281d47c388dac490776efad1, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:58.319932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616fe57-ff96-43a9-8a28-b3db43f7d094 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:58.351750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1029/2059] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:58 2022] PUT /identity/v3/projects/414cd8578be24455b2823c5c6748c67c/users/ce40c3d4281d47c388dac490776efad1/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:58.359899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0c8f9-639f-4904-9a68-eb0803ee2714 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:58.379077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0c8f9-639f-4904-9a68-eb0803ee2714 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:58.499969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daa051-cdbe-482f-93d2-c83f4f8bd55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:58.500613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daa051-cdbe-482f-93d2-c83f4f8bd55f admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:58.501279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daa051-cdbe-482f-93d2-c83f4f8bd55f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:58.501880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daa051-cdbe-482f-93d2-c83f4f8bd55f admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:58.503831 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3daa051-cdbe-482f-93d2-c83f4f8bd55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:58.505773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3daa051-cdbe-482f-93d2-c83f4f8bd55f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:58.521566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1031/2060] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:49:58.527930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616fe57-ff96-43a9-8a28-b3db43f7d094 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:58.555232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616fe57-ff96-43a9-8a28-b3db43f7d094 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:58.569938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44866f-237f-4175-812a-b5c6db70fe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:58.571381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44866f-237f-4175-812a-b5c6db70fe3e admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:58.572328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44866f-237f-4175-812a-b5c6db70fe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:58.573357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44866f-237f-4175-812a-b5c6db70fe3e admin admin] PATH_INFO: `/v3/projects/414cd8578be24455b2823c5c6748c67c/users/ce40c3d4281d47c388dac490776efad1/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:58.577809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44866f-237f-4175-812a-b5c6db70fe3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=414cd8578be24455b2823c5c6748c67c, user_id=ce40c3d4281d47c388dac490776efad1, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:58.585243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44866f-237f-4175-812a-b5c6db70fe3e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:58.617117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1030/2061] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:49:58 2022] PUT /identity/v3/projects/414cd8578be24455b2823c5c6748c67c/users/ce40c3d4281d47c388dac490776efad1/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:58.633284 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a8c2a-e6c1-45a1-8441-6640e189d107 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:58.633597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a8c2a-e6c1-45a1-8441-6640e189d107 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:58.633851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a8c2a-e6c1-45a1-8441-6640e189d107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:58.663887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-703a8c2a-e6c1-45a1-8441-6640e189d107 None None] MFA Rules not processed for user `ce40c3d4281d47c388dac490776efad1`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:58.665088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-703a8c2a-e6c1-45a1-8441-6640e189d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:58.791675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1032/2062] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:49:58.803751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44866f-237f-4175-812a-b5c6db70fe3e admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:58.806098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-af44866f-237f-4175-812a-b5c6db70fe3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:58.906622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44866f-237f-4175-812a-b5c6db70fe3e admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:58.912450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0045ff7-031c-4d45-a986-1b8c44edc64b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:58.913409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0045ff7-031c-4d45-a986-1b8c44edc64b service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:58.913779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0045ff7-031c-4d45-a986-1b8c44edc64b service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:58.914206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0045ff7-031c-4d45-a986-1b8c44edc64b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:58.992968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0045ff7-031c-4d45-a986-1b8c44edc64b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:58.995800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0045ff7-031c-4d45-a986-1b8c44edc64b service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:59.012128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1031/2063] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:49:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:49:59.196511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a8c2a-e6c1-45a1-8441-6640e189d107 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:59.196511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-703a8c2a-e6c1-45a1-8441-6640e189d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:59.327955 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a8c2a-e6c1-45a1-8441-6640e189d107 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:59.334986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:59.336657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:59.337182 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:59.337749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] PATH_INFO: `/v3/users/2e82aeba3f3b4304b0bb938aca6b92b8` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:59.340402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e82aeba3f3b4304b0bb938aca6b92b8)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:59.343018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:59.418813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e82aeba3f3b4304b0bb938aca6b92b8'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.445228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e82aeba3f3b4304b0bb938aca6b92b8'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.447076 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e82aeba3f3b4304b0bb938aca6b92b8'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.461953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e82aeba3f3b4304b0bb938aca6b92b8'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.476966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e82aeba3f3b4304b0bb938aca6b92b8'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.487817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1033/2064] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:59 2022] DELETE /identity/v3/users/2e82aeba3f3b4304b0bb938aca6b92b8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:49:59.588706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0045ff7-031c-4d45-a986-1b8c44edc64b service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:59.591123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a0045ff7-031c-4d45-a986-1b8c44edc64b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:59.633878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0045ff7-031c-4d45-a986-1b8c44edc64b service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:59.757023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:49:59.761875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:59.770507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2f8c7-8a40-4f49-90b2-20371766d9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:59.772274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2f8c7-8a40-4f49-90b2-20371766d9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:59.772786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2f8c7-8a40-4f49-90b2-20371766d9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:59.773293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2f8c7-8a40-4f49-90b2-20371766d9d3 admin admin] PATH_INFO: `/v3/users/e871e78f94c849b2961c7253b487d3aa` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:59.775554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2f8c7-8a40-4f49-90b2-20371766d9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e871e78f94c849b2961c7253b487d3aa)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:59.779468 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2f8c7-8a40-4f49-90b2-20371766d9d3 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:59.823514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8048211-76d0-4e52-8fe8-d45265b403b4 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:49:59.841222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:49:59.842197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:59.842736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:59.843160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] PATH_INFO: `/v3/projects/b17a9621d46a4dec8cc4b8946abaa2c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:59.845598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17a9621d46a4dec8cc4b8946abaa2c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:49:59.852220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:49:59.876196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c6b2f8c7-8a40-4f49-90b2-20371766d9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e871e78f94c849b2961c7253b487d3aa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.901339 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c6b2f8c7-8a40-4f49-90b2-20371766d9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e871e78f94c849b2961c7253b487d3aa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.902769 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c6b2f8c7-8a40-4f49-90b2-20371766d9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e871e78f94c849b2961c7253b487d3aa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.910923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c6b2f8c7-8a40-4f49-90b2-20371766d9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e871e78f94c849b2961c7253b487d3aa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.925777 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c6b2f8c7-8a40-4f49-90b2-20371766d9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e871e78f94c849b2961c7253b487d3aa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.940240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'request_id': 'req-7a44d328-02a1-4889-9f0a-126ec746f7d4'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.955409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'request_id': 'req-7a44d328-02a1-4889-9f0a-126ec746f7d4'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.963241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1032/2065] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:49:59 2022] DELETE /identity/v3/users/e871e78f94c849b2961c7253b487d3aa => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:49:59.969289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82468f-3e6b-4f51-b2ad-53a6f726319f None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:49:59.969696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82468f-3e6b-4f51-b2ad-53a6f726319f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:49:59.970187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82468f-3e6b-4f51-b2ad-53a6f726319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:49:59.971998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17a9621d46a4dec8cc4b8946abaa2c9', 'request_id': 'req-7a44d328-02a1-4889-9f0a-126ec746f7d4'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.990499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] The token cache is being invalidate because project b17a9621d46a4dec8cc4b8946abaa2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:49:59.990859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.991238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-2d82468f-3e6b-4f51-b2ad-53a6f726319f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:49:59.992222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a44d328-02a1-4889-9f0a-126ec746f7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:49:59.992484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2d82468f-3e6b-4f51-b2ad-53a6f726319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:49:59.994603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1034/2066] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:49:59 2022] DELETE /identity/v3/projects/b17a9621d46a4dec8cc4b8946abaa2c9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:50:00.001478 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a762a-64da-49e4-9a7f-350ff1bd3be2 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.001850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a762a-64da-49e4-9a7f-350ff1bd3be2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.002160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a762a-64da-49e4-9a7f-350ff1bd3be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.035222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-cd5a762a-64da-49e4-9a7f-350ff1bd3be2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:00.036817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-cd5a762a-64da-49e4-9a7f-350ff1bd3be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:00.082920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1033/2067] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:00.095300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82468f-3e6b-4f51-b2ad-53a6f726319f None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:00.098520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2d82468f-3e6b-4f51-b2ad-53a6f726319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:00.139282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1035/2068] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:00.158860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4967380-e249-4b78-83e1-db0372248868 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.159694 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4967380-e249-4b78-83e1-db0372248868 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.160122 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4967380-e249-4b78-83e1-db0372248868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.181524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82468f-3e6b-4f51-b2ad-53a6f726319f None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:00.183120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-e4967380-e249-4b78-83e1-db0372248868 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:00.184715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e4967380-e249-4b78-83e1-db0372248868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:00.185609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6888002-2b0f-40b3-90dd-d48d4f655b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:00.186267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6888002-2b0f-40b3-90dd-d48d4f655b25 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.186549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6888002-2b0f-40b3-90dd-d48d4f655b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.186829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6888002-2b0f-40b3-90dd-d48d4f655b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.194313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1036/2069] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:00.197677 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6888002-2b0f-40b3-90dd-d48d4f655b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:00.199128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4967380-e249-4b78-83e1-db0372248868 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:00.199340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6888002-2b0f-40b3-90dd-d48d4f655b25 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:00.208824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4967380-e249-4b78-83e1-db0372248868 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:00.214187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1034/2070] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:00.215146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599768e0-2087-4abe-b447-c6f38759ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:00.215892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599768e0-2087-4abe-b447-c6f38759ed32 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.216198 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599768e0-2087-4abe-b447-c6f38759ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.216479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599768e0-2087-4abe-b447-c6f38759ed32 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.217297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599768e0-2087-4abe-b447-c6f38759ed32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:50:00.217705 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599768e0-2087-4abe-b447-c6f38759ed32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:00.219408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599768e0-2087-4abe-b447-c6f38759ed32 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:00.234129 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1037/2071] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:50:00.242424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6888002-2b0f-40b3-90dd-d48d4f655b25 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:00.255388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6888002-2b0f-40b3-90dd-d48d4f655b25 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:00.260285 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbe65b-7003-4e95-b100-fbb583f430c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:00.260959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe65b-7003-4e95-b100-fbb583f430c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.261244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe65b-7003-4e95-b100-fbb583f430c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.261528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe65b-7003-4e95-b100-fbb583f430c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.262226 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbe65b-7003-4e95-b100-fbb583f430c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:00.264185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbe65b-7003-4e95-b100-fbb583f430c5 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:00.302670 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1035/2072] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:50:00 2022] POST /identity/v3/projects => generated 391 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:00.308804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599768e0-2087-4abe-b447-c6f38759ed32 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:00.320953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599768e0-2087-4abe-b447-c6f38759ed32 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:00.430614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b7648-32ed-474d-b820-47d5e462a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:00.431297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7648-32ed-474d-b820-47d5e462a602 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.431681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7648-32ed-474d-b820-47d5e462a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.432009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7648-32ed-474d-b820-47d5e462a602 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.432734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b7648-32ed-474d-b820-47d5e462a602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:00.434866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b7648-32ed-474d-b820-47d5e462a602 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:00.484867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1038/2073] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:50:00 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:00.490639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbe65b-7003-4e95-b100-fbb583f430c5 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:00.506481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbe65b-7003-4e95-b100-fbb583f430c5 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:00.512315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721e0e-8104-4bc8-87aa-f3cf47607bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:00.514184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721e0e-8104-4bc8-87aa-f3cf47607bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.514725 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721e0e-8104-4bc8-87aa-f3cf47607bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.515247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721e0e-8104-4bc8-87aa-f3cf47607bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.516253 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12721e0e-8104-4bc8-87aa-f3cf47607bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:00.520430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12721e0e-8104-4bc8-87aa-f3cf47607bb4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:00.540208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1036/2074] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:00.544690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b7648-32ed-474d-b820-47d5e462a602 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:00.554878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b7648-32ed-474d-b820-47d5e462a602 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:00.560717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0e17d-8585-4a19-847c-e2ccbd9ded28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:00.561877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0e17d-8585-4a19-847c-e2ccbd9ded28 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.561877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0e17d-8585-4a19-847c-e2ccbd9ded28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.562173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0e17d-8585-4a19-847c-e2ccbd9ded28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.562891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0e17d-8585-4a19-847c-e2ccbd9ded28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:00.564531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0e17d-8585-4a19-847c-e2ccbd9ded28 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:00.586634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1039/2075] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:50:00.592130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721e0e-8104-4bc8-87aa-f3cf47607bb4 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:00.603043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0e17d-8585-4a19-847c-e2ccbd9ded28 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:00.605735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721e0e-8104-4bc8-87aa-f3cf47607bb4 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:00.605936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7bf0e17d-8585-4a19-847c-e2ccbd9ded28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:00.612515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2844029-e037-4866-a852-c0de75006b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:00.614334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844029-e037-4866-a852-c0de75006b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.614626 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844029-e037-4866-a852-c0de75006b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.614900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844029-e037-4866-a852-c0de75006b1f admin admin] PATH_INFO: `/v3/projects/9fe0e3c0f5eb4d4199f084be233eb1d3/users/89539508b327427ba1a449fe30569606/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.628360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0e17d-8585-4a19-847c-e2ccbd9ded28 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:00.633540 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2844029-e037-4866-a852-c0de75006b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe0e3c0f5eb4d4199f084be233eb1d3, user_id=89539508b327427ba1a449fe30569606, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:00.635506 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:00.636733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2844029-e037-4866-a852-c0de75006b1f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:00.636858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.637242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.637650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] PATH_INFO: `/v3/projects/648e2139ed5b49e2b79857274db3a131` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.640450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=648e2139ed5b49e2b79857274db3a131)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:00.641452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:00.659923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1037/2076] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:50:00 2022] PUT /identity/v3/projects/9fe0e3c0f5eb4d4199f084be233eb1d3/users/89539508b327427ba1a449fe30569606/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:00.666457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11538-a4b7-47b5-8b51-ba756041d921 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.666744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11538-a4b7-47b5-8b51-ba756041d921 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.667023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11538-a4b7-47b5-8b51-ba756041d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.704634 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b7b11538-a4b7-47b5-8b51-ba756041d921 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:00.707515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b7b11538-a4b7-47b5-8b51-ba756041d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:00.725657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648e2139ed5b49e2b79857274db3a131', 'request_id': 'req-5d88bfa6-eaed-43f1-a477-de7ab5812368'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:00.740586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648e2139ed5b49e2b79857274db3a131', 'request_id': 'req-5d88bfa6-eaed-43f1-a477-de7ab5812368'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:00.760546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648e2139ed5b49e2b79857274db3a131', 'request_id': 'req-5d88bfa6-eaed-43f1-a477-de7ab5812368'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:00.795900 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] The token cache is being invalidate because project 648e2139ed5b49e2b79857274db3a131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:00.796635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:00.801313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:00.805358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1040/2077] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:00 2022] DELETE /identity/v3/projects/648e2139ed5b49e2b79857274db3a131 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:00.809842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:00.811378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:00.828661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1038/2078] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:00.839449 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11538-a4b7-47b5-8b51-ba756041d921 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:00.841619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b7b11538-a4b7-47b5-8b51-ba756041d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:00.940113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11538-a4b7-47b5-8b51-ba756041d921 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:00.945968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f9be9-5e4e-4bea-ac8d-f316dc9505c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:00.947761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f9be9-5e4e-4bea-ac8d-f316dc9505c8 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.949058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f9be9-5e4e-4bea-ac8d-f316dc9505c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.949058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f9be9-5e4e-4bea-ac8d-f316dc9505c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.951595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88bfa6-eaed-43f1-a477-de7ab5812368 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:00.964763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f9be9-5e4e-4bea-ac8d-f316dc9505c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:00.975793 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:00.976105 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f9be9-5e4e-4bea-ac8d-f316dc9505c8 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:00.976186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:00.976186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:00.976186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] PATH_INFO: `/v3/users/bd467f7bbd044ddc81ec8707738b250e` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:00.990142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd467f7bbd044ddc81ec8707738b250e)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:01.001272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:01.007453 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1039/2079] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:50:01.060384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f9be9-5e4e-4bea-ac8d-f316dc9505c8 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:01.062316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-155f9be9-5e4e-4bea-ac8d-f316dc9505c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:01.168029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd467f7bbd044ddc81ec8707738b250e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:01.188483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f9be9-5e4e-4bea-ac8d-f316dc9505c8 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:01.196808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bb55f-17a1-4415-9dd4-8ecc6c503ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:01.198431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bb55f-17a1-4415-9dd4-8ecc6c503ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:01.198958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bb55f-17a1-4415-9dd4-8ecc6c503ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:01.199946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bb55f-17a1-4415-9dd4-8ecc6c503ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:01.204230 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-003bb55f-17a1-4415-9dd4-8ecc6c503ac2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:01.221256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd467f7bbd044ddc81ec8707738b250e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:01.223363 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd467f7bbd044ddc81ec8707738b250e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:01.234649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd467f7bbd044ddc81ec8707738b250e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:01.251005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd467f7bbd044ddc81ec8707738b250e'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:01.264827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1041/2080] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:50:00 2022] DELETE /identity/v3/users/bd467f7bbd044ddc81ec8707738b250e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:01.271995 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:01.274209 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:01.379496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bb55f-17a1-4415-9dd4-8ecc6c503ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:01.384675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bb55f-17a1-4415-9dd4-8ecc6c503ac2 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:01.411701 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1040/2081] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:50:01.432476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a30ef-79a9-4783-b39e-784cc7f9c943 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:01.442857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efaf527-e2cf-4a61-9733-963d36dd6293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:01.444059 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaf527-e2cf-4a61-9733-963d36dd6293 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:01.444556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaf527-e2cf-4a61-9733-963d36dd6293 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:01.445055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaf527-e2cf-4a61-9733-963d36dd6293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:01.449073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-6efaf527-e2cf-4a61-9733-963d36dd6293 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:01.595634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efaf527-e2cf-4a61-9733-963d36dd6293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:01.598027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efaf527-e2cf-4a61-9733-963d36dd6293 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:01.620563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1042/2082] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:02.203467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bb55f-17a1-4415-9dd4-8ecc6c503ac2 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:02.263489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bb55f-17a1-4415-9dd4-8ecc6c503ac2 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:02.403321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:02.404798 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:02.405247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:02.405916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] PATH_INFO: `/v3/projects/448498b2362346feba74e7e682920675` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:02.407894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=448498b2362346feba74e7e682920675)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:02.410969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:02.541811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448498b2362346feba74e7e682920675', 'request_id': 'req-6598a722-9b99-4d64-b745-594f70eab4a9'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:02.561205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448498b2362346feba74e7e682920675', 'request_id': 'req-6598a722-9b99-4d64-b745-594f70eab4a9'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:02.565005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efaf527-e2cf-4a61-9733-963d36dd6293 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:02.577090 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efaf527-e2cf-4a61-9733-963d36dd6293 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:02.580139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448498b2362346feba74e7e682920675', 'request_id': 'req-6598a722-9b99-4d64-b745-594f70eab4a9'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:02.596831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] The token cache is being invalidate because project 448498b2362346feba74e7e682920675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:02.597543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:02.601238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-6598a722-9b99-4d64-b745-594f70eab4a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:02.611383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1041/2083] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:02 2022] DELETE /identity/v3/projects/448498b2362346feba74e7e682920675 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:02.614103 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f618a-ff68-4cda-b5ea-f840f9d0b3aa None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:02.614639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f618a-ff68-4cda-b5ea-f840f9d0b3aa None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:02.615025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f618a-ff68-4cda-b5ea-f840f9d0b3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:02.659979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-739f618a-ff68-4cda-b5ea-f840f9d0b3aa None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:02.661265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-739f618a-ff68-4cda-b5ea-f840f9d0b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:02.666146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459d607-6b1b-489e-9998-16bd9cedd7ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:02.667309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459d607-6b1b-489e-9998-16bd9cedd7ce service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:02.667860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459d607-6b1b-489e-9998-16bd9cedd7ce service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:02.668591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459d607-6b1b-489e-9998-16bd9cedd7ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:02.673702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a459d607-6b1b-489e-9998-16bd9cedd7ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:02.794343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1042/2084] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:02.813532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf279-e1f0-493a-946f-197cd62e85cd None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:02.814043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459d607-6b1b-489e-9998-16bd9cedd7ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:02.814821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf279-e1f0-493a-946f-197cd62e85cd None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:02.816848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459d607-6b1b-489e-9998-16bd9cedd7ce service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:02.817349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf279-e1f0-493a-946f-197cd62e85cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:02.851259 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1043/2085] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:50:02.875966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-c2caf279-e1f0-493a-946f-197cd62e85cd None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:02.878669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c2caf279-e1f0-493a-946f-197cd62e85cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:02.893990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1043/2086] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:50:02.900842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459d607-6b1b-489e-9998-16bd9cedd7ce service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:02.916241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459d607-6b1b-489e-9998-16bd9cedd7ce service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:02.926417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d06c2-94cf-40d4-9e24-f2c268d2a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:02.927116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d06c2-94cf-40d4-9e24-f2c268d2a461 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:02.927396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d06c2-94cf-40d4-9e24-f2c268d2a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:02.927666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d06c2-94cf-40d4-9e24-f2c268d2a461 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:02.939367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d06c2-94cf-40d4-9e24-f2c268d2a461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:50:02.939772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d06c2-94cf-40d4-9e24-f2c268d2a461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:02.942030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d06c2-94cf-40d4-9e24-f2c268d2a461 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:02.971212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1044/2087] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:50:02.972949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2caf279-e1f0-493a-946f-197cd62e85cd None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:02.993573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2caf279-e1f0-493a-946f-197cd62e85cd None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:03.022224 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d993-61bf-43ec-9dd3-790ac33f285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:03.023297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d993-61bf-43ec-9dd3-790ac33f285c admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:03.023734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d993-61bf-43ec-9dd3-790ac33f285c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:03.024159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d993-61bf-43ec-9dd3-790ac33f285c admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:03.025003 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0d993-61bf-43ec-9dd3-790ac33f285c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:03.033208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0d993-61bf-43ec-9dd3-790ac33f285c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:03.085811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1044/2088] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:50:02 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:50:03.103844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d06c2-94cf-40d4-9e24-f2c268d2a461 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:03.112271 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d06c2-94cf-40d4-9e24-f2c268d2a461 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:03.263180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84809b6-fd8f-4089-a926-b462e3421d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:03.263915 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84809b6-fd8f-4089-a926-b462e3421d90 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:03.264201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84809b6-fd8f-4089-a926-b462e3421d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:03.264477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84809b6-fd8f-4089-a926-b462e3421d90 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:03.265196 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84809b6-fd8f-4089-a926-b462e3421d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:03.267144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84809b6-fd8f-4089-a926-b462e3421d90 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:03.309765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1045/2089] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:50:03 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:03.314694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d993-61bf-43ec-9dd3-790ac33f285c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:03.336573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d993-61bf-43ec-9dd3-790ac33f285c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:03.348431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ee177-5a3c-4daf-acfe-905eabc07333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:03.349755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ee177-5a3c-4daf-acfe-905eabc07333 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:03.350319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ee177-5a3c-4daf-acfe-905eabc07333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:03.351010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ee177-5a3c-4daf-acfe-905eabc07333 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:03.352159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ee177-5a3c-4daf-acfe-905eabc07333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:03.354343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ee177-5a3c-4daf-acfe-905eabc07333 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:03.371266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1045/2090] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:03.372841 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84809b6-fd8f-4089-a926-b462e3421d90 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:03.391430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84809b6-fd8f-4089-a926-b462e3421d90 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:03.403392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a166cc4-ca79-47dd-98c3-b46a68402051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:03.404579 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a166cc4-ca79-47dd-98c3-b46a68402051 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:03.405019 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a166cc4-ca79-47dd-98c3-b46a68402051 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:03.405301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a166cc4-ca79-47dd-98c3-b46a68402051 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:03.406418 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a166cc4-ca79-47dd-98c3-b46a68402051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:03.412002 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a166cc4-ca79-47dd-98c3-b46a68402051 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:03.435602 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1046/2091] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:03.441099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ee177-5a3c-4daf-acfe-905eabc07333 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:03.466445 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ee177-5a3c-4daf-acfe-905eabc07333 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:03.478201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d40e-25b9-4875-af4a-8a7e3d172018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:03.479104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d40e-25b9-4875-af4a-8a7e3d172018 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:03.479391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d40e-25b9-4875-af4a-8a7e3d172018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:03.479661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d40e-25b9-4875-af4a-8a7e3d172018 admin admin] PATH_INFO: `/v3/projects/6a097b1b830e4515807fd11d0b428459/users/bd73edf7e03544bf9a48e2355c458caa/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:03.511741 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4d40e-25b9-4875-af4a-8a7e3d172018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a097b1b830e4515807fd11d0b428459, user_id=bd73edf7e03544bf9a48e2355c458caa, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:03.521781 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4d40e-25b9-4875-af4a-8a7e3d172018 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:03.548892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1046/2092] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:50:03 2022] PUT /identity/v3/projects/6a097b1b830e4515807fd11d0b428459/users/bd73edf7e03544bf9a48e2355c458caa/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:03.565426 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeb4fa-e76a-4c78-9125-0f9a315e7e94 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:03.566095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeb4fa-e76a-4c78-9125-0f9a315e7e94 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:03.566405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeb4fa-e76a-4c78-9125-0f9a315e7e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:03.615149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-34eeb4fa-e76a-4c78-9125-0f9a315e7e94 None None] MFA Rules not processed for user `bd73edf7e03544bf9a48e2355c458caa`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:03.615149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-34eeb4fa-e76a-4c78-9125-0f9a315e7e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:03.749172 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1047/2093] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:03.771925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d40e-25b9-4875-af4a-8a7e3d172018 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:03.774997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c8d4d40e-25b9-4875-af4a-8a7e3d172018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:03.993342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d40e-25b9-4875-af4a-8a7e3d172018 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:04.008398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3d211-8b60-4982-90a7-796108305c03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:04.010130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3d211-8b60-4982-90a7-796108305c03 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:04.010600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3d211-8b60-4982-90a7-796108305c03 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:04.011059 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3d211-8b60-4982-90a7-796108305c03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:04.044568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3d211-8b60-4982-90a7-796108305c03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:04.044568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3d211-8b60-4982-90a7-796108305c03 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:04.073682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1047/2094] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:50:08.306516 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4028f-95b7-4686-b805-75047b001f47 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:08.307474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4028f-95b7-4686-b805-75047b001f47 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:08.307474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4028f-95b7-4686-b805-75047b001f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:08.341941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a0c4028f-95b7-4686-b805-75047b001f47 None None] MFA Rules not processed for user `89539508b327427ba1a449fe30569606`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:08.344099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a0c4028f-95b7-4686-b805-75047b001f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:08.436293 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1048/2095] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:08.447248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed237f74-3d9a-4da9-b88d-0ab9e81b2eb5 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:08.447840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed237f74-3d9a-4da9-b88d-0ab9e81b2eb5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:08.448058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed237f74-3d9a-4da9-b88d-0ab9e81b2eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:08.469620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-ed237f74-3d9a-4da9-b88d-0ab9e81b2eb5 None None] MFA Rules not processed for user `89539508b327427ba1a449fe30569606`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:08.470901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ed237f74-3d9a-4da9-b88d-0ab9e81b2eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:08.479802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1048/2096] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:08.491534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4028f-95b7-4686-b805-75047b001f47 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:08.493355 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a0c4028f-95b7-4686-b805-75047b001f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:08.585392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4028f-95b7-4686-b805-75047b001f47 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:08.591377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c74f-a49f-42e8-a0eb-877aeda69caf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:08.592071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c74f-a49f-42e8-a0eb-877aeda69caf service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:08.592356 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c74f-a49f-42e8-a0eb-877aeda69caf service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:08.592627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c74f-a49f-42e8-a0eb-877aeda69caf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:08.601679 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412c74f-a49f-42e8-a0eb-877aeda69caf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:08.603423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412c74f-a49f-42e8-a0eb-877aeda69caf service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:08.614201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1049/2097] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:50:09.497648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9169d-5347-497c-b819-93fac181d6fc None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:09.498472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9169d-5347-497c-b819-93fac181d6fc None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:09.498472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9169d-5347-497c-b819-93fac181d6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:09.525842 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d0a9169d-5347-497c-b819-93fac181d6fc None None] MFA Rules not processed for user `89539508b327427ba1a449fe30569606`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:09.527299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d0a9169d-5347-497c-b819-93fac181d6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:09.535543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1049/2098] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:11.005876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c74f-a49f-42e8-a0eb-877aeda69caf service nova] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:11.007577 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3412c74f-a49f-42e8-a0eb-877aeda69caf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:11.225508 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9169d-5347-497c-b819-93fac181d6fc None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:11.226727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c74f-a49f-42e8-a0eb-877aeda69caf service nova] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:11.228590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d0a9169d-5347-497c-b819-93fac181d6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:11.245082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792ec07-9c20-49bb-a181-440ea2546cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:11.246575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792ec07-9c20-49bb-a181-440ea2546cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:11.246872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792ec07-9c20-49bb-a181-440ea2546cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:11.247153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792ec07-9c20-49bb-a181-440ea2546cd2 admin admin] PATH_INFO: `/v3/users/81c07f419cd344cab511d20f2607de81` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:11.258725 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792ec07-9c20-49bb-a181-440ea2546cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c07f419cd344cab511d20f2607de81)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:11.260876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792ec07-9c20-49bb-a181-440ea2546cd2 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:11.264537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9169d-5347-497c-b819-93fac181d6fc None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:11.292463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799f17d-ad0a-4a20-a8e8-5ad6e451ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:11.293796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799f17d-ad0a-4a20-a8e8-5ad6e451ef7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:11.294298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799f17d-ad0a-4a20-a8e8-5ad6e451ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:11.294726 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799f17d-ad0a-4a20-a8e8-5ad6e451ef7a admin admin] PATH_INFO: `/v3/users/bbe6984f3cbe4c5385797618c09a1d7e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:11.314529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799f17d-ad0a-4a20-a8e8-5ad6e451ef7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe6984f3cbe4c5385797618c09a1d7e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:11.326239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799f17d-ad0a-4a20-a8e8-5ad6e451ef7a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:11.483212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-2799f17d-ad0a-4a20-a8e8-5ad6e451ef7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe6984f3cbe4c5385797618c09a1d7e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:11.487084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2792ec07-9c20-49bb-a181-440ea2546cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c07f419cd344cab511d20f2607de81'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:11.509551 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-2799f17d-ad0a-4a20-a8e8-5ad6e451ef7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe6984f3cbe4c5385797618c09a1d7e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:11.512269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-2799f17d-ad0a-4a20-a8e8-5ad6e451ef7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe6984f3cbe4c5385797618c09a1d7e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:11.514240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-2799f17d-ad0a-4a20-a8e8-5ad6e451ef7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe6984f3cbe4c5385797618c09a1d7e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:11.526137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-2799f17d-ad0a-4a20-a8e8-5ad6e451ef7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe6984f3cbe4c5385797618c09a1d7e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:11.549918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1050/2099] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:50:11 2022] DELETE /identity/v3/users/bbe6984f3cbe4c5385797618c09a1d7e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:11.560638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344df0-c4b8-4d3e-8bef-c77c65612cb2 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:11.562952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344df0-c4b8-4d3e-8bef-c77c65612cb2 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:11.563343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344df0-c4b8-4d3e-8bef-c77c65612cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:11.568591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2792ec07-9c20-49bb-a181-440ea2546cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c07f419cd344cab511d20f2607de81'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:11.571728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2792ec07-9c20-49bb-a181-440ea2546cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c07f419cd344cab511d20f2607de81'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:11.599047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2792ec07-9c20-49bb-a181-440ea2546cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c07f419cd344cab511d20f2607de81'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:11.627241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f6344df0-c4b8-4d3e-8bef-c77c65612cb2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:11.630840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f6344df0-c4b8-4d3e-8bef-c77c65612cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:11.649836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2792ec07-9c20-49bb-a181-440ea2546cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c07f419cd344cab511d20f2607de81'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:11.683019 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1050/2100] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:50:11 2022] DELETE /identity/v3/users/81c07f419cd344cab511d20f2607de81 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:11.684940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1921d-803c-44a2-a9d3-0518d6854da3 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:11.685225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1921d-803c-44a2-a9d3-0518d6854da3 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:11.685502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1921d-803c-44a2-a9d3-0518d6854da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:11.770884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-cdc1921d-803c-44a2-a9d3-0518d6854da3 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:11.781936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-cdc1921d-803c-44a2-a9d3-0518d6854da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:11.908359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1051/2101] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:11.932058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6344df0-c4b8-4d3e-8bef-c77c65612cb2 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:11.939489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f6344df0-c4b8-4d3e-8bef-c77c65612cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:12.012966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1051/2102] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:12.032501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1921d-803c-44a2-a9d3-0518d6854da3 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:12.036373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-cdc1921d-803c-44a2-a9d3-0518d6854da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:12.169395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6344df0-c4b8-4d3e-8bef-c77c65612cb2 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:12.250939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1921d-803c-44a2-a9d3-0518d6854da3 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:12.264273 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d169cb-23c8-46fe-a0aa-c414b95ff314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:12.265968 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d169cb-23c8-46fe-a0aa-c414b95ff314 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:12.276663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d169cb-23c8-46fe-a0aa-c414b95ff314 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:12.277235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d169cb-23c8-46fe-a0aa-c414b95ff314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:12.299876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d169cb-23c8-46fe-a0aa-c414b95ff314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:12.302278 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d169cb-23c8-46fe-a0aa-c414b95ff314 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:12.314471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1052/2103] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:12.358924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b4536-ad1c-4581-8cc0-233c6291f918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:12.364037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b4536-ad1c-4581-8cc0-233c6291f918 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:12.364613 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b4536-ad1c-4581-8cc0-233c6291f918 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:12.365080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b4536-ad1c-4581-8cc0-233c6291f918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:12.402527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b4536-ad1c-4581-8cc0-233c6291f918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:12.405998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b4536-ad1c-4581-8cc0-233c6291f918 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:12.425185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1052/2104] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:13.135466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d169cb-23c8-46fe-a0aa-c414b95ff314 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:13.137410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-24d169cb-23c8-46fe-a0aa-c414b95ff314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:13.168929 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d169cb-23c8-46fe-a0aa-c414b95ff314 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:13.181043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:13.183465 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:13.184189 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:13.186789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] PATH_INFO: `/v3/projects/9be36a3ed343451295039adbb88d7df0` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:13.190996 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be36a3ed343451295039adbb88d7df0)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:13.191804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:13.356788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b4536-ad1c-4581-8cc0-233c6291f918 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:13.359405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-dc1b4536-ad1c-4581-8cc0-233c6291f918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:13.383663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be36a3ed343451295039adbb88d7df0', 'request_id': 'req-91ffab51-ba3a-4677-9864-79cc671ec217'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:13.414912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be36a3ed343451295039adbb88d7df0', 'request_id': 'req-91ffab51-ba3a-4677-9864-79cc671ec217'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:13.435571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be36a3ed343451295039adbb88d7df0', 'request_id': 'req-91ffab51-ba3a-4677-9864-79cc671ec217'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:13.459502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b4536-ad1c-4581-8cc0-233c6291f918 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:13.489612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] The token cache is being invalidate because project 9be36a3ed343451295039adbb88d7df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:13.501419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:13.503816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-91ffab51-ba3a-4677-9864-79cc671ec217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:13.506649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1053/2105] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:13 2022] DELETE /identity/v3/projects/9be36a3ed343451295039adbb88d7df0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:13.508288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984ef4f-4c61-401e-80bc-a27fce2477a4 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:13.509199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984ef4f-4c61-401e-80bc-a27fce2477a4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:13.509808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984ef4f-4c61-401e-80bc-a27fce2477a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:13.570815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-3984ef4f-4c61-401e-80bc-a27fce2477a4 None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:13.572557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3984ef4f-4c61-401e-80bc-a27fce2477a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:13.749921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:13.751544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:13.752205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1054/2106] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:13.753089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:13.753587 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] PATH_INFO: `/v3/projects/1087d7406b5e4518abb1c2645811bd4d` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:13.755564 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1087d7406b5e4518abb1c2645811bd4d)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:13.758598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:13.759974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984ef4f-4c61-401e-80bc-a27fce2477a4 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:13.764874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3984ef4f-4c61-401e-80bc-a27fce2477a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:13.822348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984ef4f-4c61-401e-80bc-a27fce2477a4 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:13.837009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:13.838105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:13.839831 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:13.840342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] PATH_INFO: `/v3/users/5240133b698c4cec973a7f737b65ff7d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:13.842594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5240133b698c4cec973a7f737b65ff7d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:13.845055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:13.901727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1087d7406b5e4518abb1c2645811bd4d', 'request_id': 'req-ea864906-615b-4047-a238-cec8870ac275'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:13.928861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1087d7406b5e4518abb1c2645811bd4d', 'request_id': 'req-ea864906-615b-4047-a238-cec8870ac275'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:13.949626 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1087d7406b5e4518abb1c2645811bd4d', 'request_id': 'req-ea864906-615b-4047-a238-cec8870ac275'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:13.974204 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] The token cache is being invalidate because project 1087d7406b5e4518abb1c2645811bd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:13.974637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:13.975482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:13.981829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1053/2107] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:13 2022] DELETE /identity/v3/projects/1087d7406b5e4518abb1c2645811bd4d => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:13.982891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5240133b698c4cec973a7f737b65ff7d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:13.983573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:13.985684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:14.022479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5240133b698c4cec973a7f737b65ff7d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:14.026313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5240133b698c4cec973a7f737b65ff7d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:14.047670 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5240133b698c4cec973a7f737b65ff7d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:14.069050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5240133b698c4cec973a7f737b65ff7d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:14.083440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1055/2108] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:50:13 2022] DELETE /identity/v3/users/5240133b698c4cec973a7f737b65ff7d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:14.084718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:14.099402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864906-615b-4047-a238-cec8870ac275 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:14.104007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:14.267593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec42ec-38a2-42bc-ac31-b63f9101d735 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:14.272388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec42ec-38a2-42bc-ac31-b63f9101d735 service swift] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:14.273095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec42ec-38a2-42bc-ac31-b63f9101d735 service swift] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:14.273536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec42ec-38a2-42bc-ac31-b63f9101d735 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:14.276728 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b5ec42ec-38a2-42bc-ac31-b63f9101d735 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:14.285394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bcb17-2f05-4f27-a295-9bb5625ece78 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:14.293655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:14.295195 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:14.296293 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:14.296785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] PATH_INFO: `/v3/users/549ac177ddda4b59ac6b53f601eee637` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:14.301460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549ac177ddda4b59ac6b53f601eee637)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:14.304784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:14.414768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549ac177ddda4b59ac6b53f601eee637'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:14.427861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec42ec-38a2-42bc-ac31-b63f9101d735 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:14.437934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec42ec-38a2-42bc-ac31-b63f9101d735 service swift] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:14.453545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549ac177ddda4b59ac6b53f601eee637'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:14.456334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549ac177ddda4b59ac6b53f601eee637'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:14.458316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1054/2109] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:50:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:50:14.481344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549ac177ddda4b59ac6b53f601eee637'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:14.494016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549ac177ddda4b59ac6b53f601eee637'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:14.505556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1056/2110] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:50:14 2022] DELETE /identity/v3/users/549ac177ddda4b59ac6b53f601eee637 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:14.649872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec42ec-38a2-42bc-ac31-b63f9101d735 service swift] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:14.651519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b5ec42ec-38a2-42bc-ac31-b63f9101d735 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:14.694353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:14.696500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:14.712553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec42ec-38a2-42bc-ac31-b63f9101d735 service swift] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:14.879269 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2fb48-f787-45d1-83e7-883400f1c685 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:14.889278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff132189-35cf-46a7-9cf4-6b802ba502d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:14.890945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff132189-35cf-46a7-9cf4-6b802ba502d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:14.892507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff132189-35cf-46a7-9cf4-6b802ba502d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:14.895324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff132189-35cf-46a7-9cf4-6b802ba502d9 admin admin] PATH_INFO: `/v3/users/bd73edf7e03544bf9a48e2355c458caa` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:14.897292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:14.898312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:14.898707 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:14.899094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] PATH_INFO: `/v3/projects/0f3d548518624e9dbf8bc2efb86c7cec` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:14.901005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3d548518624e9dbf8bc2efb86c7cec)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:14.903190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff132189-35cf-46a7-9cf4-6b802ba502d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd73edf7e03544bf9a48e2355c458caa)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:14.903479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:14.919424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff132189-35cf-46a7-9cf4-6b802ba502d9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:15.007243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3d548518624e9dbf8bc2efb86c7cec', 'request_id': 'req-65215e59-fd54-48f6-b5cb-c18102949398'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.040857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3d548518624e9dbf8bc2efb86c7cec', 'request_id': 'req-65215e59-fd54-48f6-b5cb-c18102949398'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.045509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ff132189-35cf-46a7-9cf4-6b802ba502d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd73edf7e03544bf9a48e2355c458caa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.062492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3d548518624e9dbf8bc2efb86c7cec', 'request_id': 'req-65215e59-fd54-48f6-b5cb-c18102949398'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.069952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ff132189-35cf-46a7-9cf4-6b802ba502d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd73edf7e03544bf9a48e2355c458caa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.071378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ff132189-35cf-46a7-9cf4-6b802ba502d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd73edf7e03544bf9a48e2355c458caa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.072242 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ff132189-35cf-46a7-9cf4-6b802ba502d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd73edf7e03544bf9a48e2355c458caa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.115093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ff132189-35cf-46a7-9cf4-6b802ba502d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd73edf7e03544bf9a48e2355c458caa'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.117195 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] The token cache is being invalidate because project 0f3d548518624e9dbf8bc2efb86c7cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:15.122075 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.129930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-65215e59-fd54-48f6-b5cb-c18102949398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.140094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1057/2111] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:14 2022] DELETE /identity/v3/projects/0f3d548518624e9dbf8bc2efb86c7cec => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:15.142728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98691405-ead1-406d-829c-02faeacce83d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:15.144192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98691405-ead1-406d-829c-02faeacce83d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:15.144570 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98691405-ead1-406d-829c-02faeacce83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:15.164411 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1055/2112] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:50:14 2022] DELETE /identity/v3/users/bd73edf7e03544bf9a48e2355c458caa => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:15.169532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7e4b3-f026-44d8-81a8-c7b3cb921ab4 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:15.169724 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7e4b3-f026-44d8-81a8-c7b3cb921ab4 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:15.169997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7e4b3-f026-44d8-81a8-c7b3cb921ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:15.220385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-34a7e4b3-f026-44d8-81a8-c7b3cb921ab4 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:15.222255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-34a7e4b3-f026-44d8-81a8-c7b3cb921ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:15.268054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-98691405-ead1-406d-829c-02faeacce83d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:15.272157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-98691405-ead1-406d-829c-02faeacce83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:15.416962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1058/2113] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:15.429767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cbfe6-dde6-4f4c-b45b-68577d26eb93 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:15.430506 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cbfe6-dde6-4f4c-b45b-68577d26eb93 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:15.430967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cbfe6-dde6-4f4c-b45b-68577d26eb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:15.454232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1056/2114] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:50:15.470356 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7e4b3-f026-44d8-81a8-c7b3cb921ab4 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:15.474558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-34a7e4b3-f026-44d8-81a8-c7b3cb921ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:15.482766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-221cbfe6-dde6-4f4c-b45b-68577d26eb93 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:15.489099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-221cbfe6-dde6-4f4c-b45b-68577d26eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:15.579069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1059/2115] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:50:15.581650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cbfe6-dde6-4f4c-b45b-68577d26eb93 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:15.583415 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-221cbfe6-dde6-4f4c-b45b-68577d26eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:15.617913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cbfe6-dde6-4f4c-b45b-68577d26eb93 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:15.630594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:15.633026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:15.633346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:15.633602 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] PATH_INFO: `/v3/projects/e0f7570ea0444dfaade6618479165fd4` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:15.634985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f7570ea0444dfaade6618479165fd4)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:15.638526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:15.676593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7e4b3-f026-44d8-81a8-c7b3cb921ab4 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:15.687501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd52c-6382-424f-a243-54a02cee357d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:15.688932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd52c-6382-424f-a243-54a02cee357d service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:15.689644 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd52c-6382-424f-a243-54a02cee357d service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:15.691640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd52c-6382-424f-a243-54a02cee357d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:15.714521 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddd52c-6382-424f-a243-54a02cee357d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:15.717457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddd52c-6382-424f-a243-54a02cee357d service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:15.736331 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f7570ea0444dfaade6618479165fd4', 'request_id': 'req-bf0d823e-23f6-4446-929c-4d0a3ee43448'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.752186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1057/2116] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:15.754051 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd52c-6382-424f-a243-54a02cee357d service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:15.766293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd52c-6382-424f-a243-54a02cee357d service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:15.768017 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f7570ea0444dfaade6618479165fd4', 'request_id': 'req-bf0d823e-23f6-4446-929c-4d0a3ee43448'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.795237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f7570ea0444dfaade6618479165fd4', 'request_id': 'req-bf0d823e-23f6-4446-929c-4d0a3ee43448'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.832388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] The token cache is being invalidate because project e0f7570ea0444dfaade6618479165fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:15.832956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.834688 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:15.837371 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1060/2117] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:15 2022] DELETE /identity/v3/projects/e0f7570ea0444dfaade6618479165fd4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:15.844080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:15.848552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:16.015496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c69939-d171-4e66-8e43-e18dbe11823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:16.016373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c69939-d171-4e66-8e43-e18dbe11823b admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:16.017137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c69939-d171-4e66-8e43-e18dbe11823b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:16.017591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c69939-d171-4e66-8e43-e18dbe11823b admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:16.020753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c69939-d171-4e66-8e43-e18dbe11823b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:50:16.021421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c69939-d171-4e66-8e43-e18dbe11823b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:16.025335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c69939-d171-4e66-8e43-e18dbe11823b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:16.037211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d823e-23f6-4446-929c-4d0a3ee43448 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:16.052918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1058/2118] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:50:16.055488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831f2c9-9c70-4d59-beca-46147fe75e9c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:16.055966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831f2c9-9c70-4d59-beca-46147fe75e9c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:16.056484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831f2c9-9c70-4d59-beca-46147fe75e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:16.068651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:16.070641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:16.071454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:16.072466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] PATH_INFO: `/v3/users/ce40c3d4281d47c388dac490776efad1` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:16.075034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce40c3d4281d47c388dac490776efad1)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:16.078773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:16.114389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-5831f2c9-9c70-4d59-beca-46147fe75e9c None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:16.116859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5831f2c9-9c70-4d59-beca-46147fe75e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:16.187275 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce40c3d4281d47c388dac490776efad1'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:16.221364 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce40c3d4281d47c388dac490776efad1'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:16.222898 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce40c3d4281d47c388dac490776efad1'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:16.241312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce40c3d4281d47c388dac490776efad1'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:16.255760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce40c3d4281d47c388dac490776efad1'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:16.267008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1061/2119] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:50:15 2022] DELETE /identity/v3/users/ce40c3d4281d47c388dac490776efad1 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:50:16.269532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:16.276305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:16.311845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1059/2120] 10.222.0.72 () {58 vars in 967 bytes} [Mon May 16 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:16.322944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831f2c9-9c70-4d59-beca-46147fe75e9c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:16.332416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5831f2c9-9c70-4d59-beca-46147fe75e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:16.373009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697f4bd-e1dc-4b77-8829-c86f874529f1 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:16.385656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3601892-3301-4e9b-84ed-d4a417f233cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:16.387630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601892-3301-4e9b-84ed-d4a417f233cc admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:16.388529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601892-3301-4e9b-84ed-d4a417f233cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:16.389130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601892-3301-4e9b-84ed-d4a417f233cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:16.391156 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3601892-3301-4e9b-84ed-d4a417f233cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:16.396606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3601892-3301-4e9b-84ed-d4a417f233cc admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:16.437010 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1062/2121] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:50:16 2022] POST /identity/v3/projects => generated 361 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:16.443827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3601892-3301-4e9b-84ed-d4a417f233cc admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:16.558975 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831f2c9-9c70-4d59-beca-46147fe75e9c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:16.605125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3601892-3301-4e9b-84ed-d4a417f233cc admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:16.611403 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774a911-6c52-4b0c-be75-d6244da590f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:16.612233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774a911-6c52-4b0c-be75-d6244da590f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:16.612781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774a911-6c52-4b0c-be75-d6244da590f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:16.612979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774a911-6c52-4b0c-be75-d6244da590f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:16.613718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774a911-6c52-4b0c-be75-d6244da590f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:16.615774 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774a911-6c52-4b0c-be75-d6244da590f4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:16.645436 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1063/2122] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:50:16 2022] POST /identity/v3/users => generated 281 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:16.646289 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774a911-6c52-4b0c-be75-d6244da590f4 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:16.648786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3774a911-6c52-4b0c-be75-d6244da590f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:16.667057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774a911-6c52-4b0c-be75-d6244da590f4 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:16.676498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2140fe0-c4ca-4b09-bd1a-1643b102343c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:16.677551 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2140fe0-c4ca-4b09-bd1a-1643b102343c service swift] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:16.678092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2140fe0-c4ca-4b09-bd1a-1643b102343c service swift] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:16.678203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:16.678976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2140fe0-c4ca-4b09-bd1a-1643b102343c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:16.679319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:16.679609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:16.679927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] PATH_INFO: `/v3/projects/6a097b1b830e4515807fd11d0b428459` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:16.681418 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a097b1b830e4515807fd11d0b428459)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:16.684378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:16.752080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a097b1b830e4515807fd11d0b428459', 'request_id': 'req-af7c6856-e38b-4ea8-b80a-d8ec4850146d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:16.765175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a097b1b830e4515807fd11d0b428459', 'request_id': 'req-af7c6856-e38b-4ea8-b80a-d8ec4850146d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:16.778613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a097b1b830e4515807fd11d0b428459', 'request_id': 'req-af7c6856-e38b-4ea8-b80a-d8ec4850146d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:16.780752 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2140fe0-c4ca-4b09-bd1a-1643b102343c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:16.783415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2140fe0-c4ca-4b09-bd1a-1643b102343c service swift] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:16.796774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1060/2123] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:50:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:50:16.798145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2140fe0-c4ca-4b09-bd1a-1643b102343c service swift] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:16.804430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] The token cache is being invalidate because project 6a097b1b830e4515807fd11d0b428459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:16.804739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:16.805635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-af7c6856-e38b-4ea8-b80a-d8ec4850146d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:16.807891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1064/2124] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:16 2022] DELETE /identity/v3/projects/6a097b1b830e4515807fd11d0b428459 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:16.816812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791a97-3c9e-4512-aea6-25203ec0c019 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:16.817694 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791a97-3c9e-4512-aea6-25203ec0c019 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:16.818247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2140fe0-c4ca-4b09-bd1a-1643b102343c service swift] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:16.818518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791a97-3c9e-4512-aea6-25203ec0c019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:16.855119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8e791a97-3c9e-4512-aea6-25203ec0c019 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:16.856772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8e791a97-3c9e-4512-aea6-25203ec0c019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:16.939913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23990657-64b1-4f59-8fe6-3ff90d87b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:16.940704 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23990657-64b1-4f59-8fe6-3ff90d87b9dd admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:16.940986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23990657-64b1-4f59-8fe6-3ff90d87b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:16.941263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23990657-64b1-4f59-8fe6-3ff90d87b9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:16.942080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23990657-64b1-4f59-8fe6-3ff90d87b9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:16.944522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23990657-64b1-4f59-8fe6-3ff90d87b9dd admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:16.957927 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1061/2125] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:16.961746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23990657-64b1-4f59-8fe6-3ff90d87b9dd admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:16.965707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-23990657-64b1-4f59-8fe6-3ff90d87b9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:16.983276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23990657-64b1-4f59-8fe6-3ff90d87b9dd admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:16.990757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac452e93-6dd0-4cfc-8f08-a8030fda803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:16.992639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac452e93-6dd0-4cfc-8f08-a8030fda803c admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:16.993695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac452e93-6dd0-4cfc-8f08-a8030fda803c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:16.995460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac452e93-6dd0-4cfc-8f08-a8030fda803c admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:16.997768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac452e93-6dd0-4cfc-8f08-a8030fda803c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:17.000087 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac452e93-6dd0-4cfc-8f08-a8030fda803c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:17.009561 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1065/2126] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:17.020892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461754-8b0d-4573-8236-94aa8dbe0b85 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.021337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1062/2127] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:50:17.024394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461754-8b0d-4573-8236-94aa8dbe0b85 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.024767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67461754-8b0d-4573-8236-94aa8dbe0b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.025177 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac452e93-6dd0-4cfc-8f08-a8030fda803c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:17.043561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac452e93-6dd0-4cfc-8f08-a8030fda803c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:17.051622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-67461754-8b0d-4573-8236-94aa8dbe0b85 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:17.053010 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-67461754-8b0d-4573-8236-94aa8dbe0b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:17.055737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b66c36-5d03-411c-ad75-7fcd37bedaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:17.057664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66c36-5d03-411c-ad75-7fcd37bedaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.058747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66c36-5d03-411c-ad75-7fcd37bedaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.058913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66c36-5d03-411c-ad75-7fcd37bedaa4 admin admin] PATH_INFO: `/v3/projects/c638d227475f4109809eba7eb76e6fbc/users/19d4214e1104483ab4caf5b6fe36b606/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.063244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1066/2128] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:50:17.073294 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67461754-8b0d-4573-8236-94aa8dbe0b85 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:17.084974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67461754-8b0d-4573-8236-94aa8dbe0b85 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:17.093973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f4185-2a10-4bcf-9990-b4f70459e1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:17.095107 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f4185-2a10-4bcf-9990-b4f70459e1ee admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.095415 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f4185-2a10-4bcf-9990-b4f70459e1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.095911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f4185-2a10-4bcf-9990-b4f70459e1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.098615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f4185-2a10-4bcf-9990-b4f70459e1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:50:17.099132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f4185-2a10-4bcf-9990-b4f70459e1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:17.105146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f4185-2a10-4bcf-9990-b4f70459e1ee admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:17.105910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b66c36-5d03-411c-ad75-7fcd37bedaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c638d227475f4109809eba7eb76e6fbc, user_id=19d4214e1104483ab4caf5b6fe36b606, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:17.110088 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b66c36-5d03-411c-ad75-7fcd37bedaa4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:17.126521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1067/2129] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:50:17.129132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1063/2130] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:50:17 2022] PUT /identity/v3/projects/c638d227475f4109809eba7eb76e6fbc/users/19d4214e1104483ab4caf5b6fe36b606/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:17.139119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f4185-2a10-4bcf-9990-b4f70459e1ee admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:17.149729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf95b6-db6c-43a4-8922-2992dd5706c8 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.150032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf95b6-db6c-43a4-8922-2992dd5706c8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.150319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf95b6-db6c-43a4-8922-2992dd5706c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.152088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f4185-2a10-4bcf-9990-b4f70459e1ee admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:17.212928 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4fcf95b6-db6c-43a4-8922-2992dd5706c8 None None] MFA Rules not processed for user `19d4214e1104483ab4caf5b6fe36b606`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:17.214438 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4fcf95b6-db6c-43a4-8922-2992dd5706c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:17.234467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1829849-b383-4c52-bc92-b1f625840749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:17.235884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829849-b383-4c52-bc92-b1f625840749 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.236535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829849-b383-4c52-bc92-b1f625840749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.237203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829849-b383-4c52-bc92-b1f625840749 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.239060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1829849-b383-4c52-bc92-b1f625840749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:17.243479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1829849-b383-4c52-bc92-b1f625840749 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:17.285181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1068/2131] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:50:17 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:50:17.285181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58455a0-21b3-4d20-b04e-e2cec2fcfea2 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.285181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58455a0-21b3-4d20-b04e-e2cec2fcfea2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.285181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58455a0-21b3-4d20-b04e-e2cec2fcfea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.305043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a58455a0-21b3-4d20-b04e-e2cec2fcfea2 None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:17.307091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a58455a0-21b3-4d20-b04e-e2cec2fcfea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:17.310413 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1064/2132] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:17.311378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf95b6-db6c-43a4-8922-2992dd5706c8 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:17.361229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf95b6-db6c-43a4-8922-2992dd5706c8 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:17.398655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1069/2133] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:50:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:17.400254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58455a0-21b3-4d20-b04e-e2cec2fcfea2 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:17.402110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a58455a0-21b3-4d20-b04e-e2cec2fcfea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:17.460390 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aa138-ed95-4d71-a710-84884c66c96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:17.461417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa138-ed95-4d71-a710-84884c66c96d admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.461886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa138-ed95-4d71-a710-84884c66c96d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.462337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa138-ed95-4d71-a710-84884c66c96d admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.463271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315aa138-ed95-4d71-a710-84884c66c96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:17.465788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315aa138-ed95-4d71-a710-84884c66c96d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:17.478592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58455a0-21b3-4d20-b04e-e2cec2fcfea2 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:17.490742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379ea5a-923e-4994-a146-b1592ac75d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:17.492546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379ea5a-923e-4994-a146-b1592ac75d09 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.493109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379ea5a-923e-4994-a146-b1592ac75d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.493627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379ea5a-923e-4994-a146-b1592ac75d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.497129 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1065/2134] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:50:17 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:17.498242 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aa138-ed95-4d71-a710-84884c66c96d admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:17.500324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-315aa138-ed95-4d71-a710-84884c66c96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:17.616472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aa138-ed95-4d71-a710-84884c66c96d admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:17.623192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379ea5a-923e-4994-a146-b1592ac75d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:17.624399 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0081a-5e4d-4ce2-a7f8-d5355446e444 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:17.625203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379ea5a-923e-4994-a146-b1592ac75d09 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:17.625936 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0081a-5e4d-4ce2-a7f8-d5355446e444 service swift] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.626515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0081a-5e4d-4ce2-a7f8-d5355446e444 service swift] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.627079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0081a-5e4d-4ce2-a7f8-d5355446e444 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.638803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0081a-5e4d-4ce2-a7f8-d5355446e444 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:17.640637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0081a-5e4d-4ce2-a7f8-d5355446e444 service swift] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:17.641485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1070/2135] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:17.643479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379ea5a-923e-4994-a146-b1592ac75d09 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:17.651974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1066/2136] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:50:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:50:17.653342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0081a-5e4d-4ce2-a7f8-d5355446e444 service swift] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:17.654724 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3cb0081a-5e4d-4ce2-a7f8-d5355446e444 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:17.672121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379ea5a-923e-4994-a146-b1592ac75d09 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:17.673318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0081a-5e4d-4ce2-a7f8-d5355446e444 service swift] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:17.678765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347466-0f00-409d-9a74-a7cd76e8e4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:17.679474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347466-0f00-409d-9a74-a7cd76e8e4db admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.679785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347466-0f00-409d-9a74-a7cd76e8e4db admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.680184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347466-0f00-409d-9a74-a7cd76e8e4db admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.680990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:17.681297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf347466-0f00-409d-9a74-a7cd76e8e4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:17.682820 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.683138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf347466-0f00-409d-9a74-a7cd76e8e4db admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:17.683877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.684440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] PATH_INFO: `/v3/projects/414cd8578be24455b2823c5c6748c67c` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.686943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] RBAC: Authorizing `identity:delete_project(project_id=414cd8578be24455b2823c5c6748c67c)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:17.691256 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:17.699862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1071/2137] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:17.700844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347466-0f00-409d-9a74-a7cd76e8e4db admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:17.723642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347466-0f00-409d-9a74-a7cd76e8e4db admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:17.740614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9595c-838c-4885-bfec-4e2606e212bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:17.741553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9595c-838c-4885-bfec-4e2606e212bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.741838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9595c-838c-4885-bfec-4e2606e212bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.742154 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9595c-838c-4885-bfec-4e2606e212bb admin admin] PATH_INFO: `/v3/users/19d4214e1104483ab4caf5b6fe36b606` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:17.744107 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9595c-838c-4885-bfec-4e2606e212bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d4214e1104483ab4caf5b6fe36b606)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:17.746810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9595c-838c-4885-bfec-4e2606e212bb admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:17.808837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414cd8578be24455b2823c5c6748c67c', 'request_id': 'req-57e1c443-1829-4770-85e8-0b43c731424c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:17.842456 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414cd8578be24455b2823c5c6748c67c', 'request_id': 'req-57e1c443-1829-4770-85e8-0b43c731424c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:17.864541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414cd8578be24455b2823c5c6748c67c', 'request_id': 'req-57e1c443-1829-4770-85e8-0b43c731424c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:17.866265 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5df9595c-838c-4885-bfec-4e2606e212bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d4214e1104483ab4caf5b6fe36b606'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:17.903594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5df9595c-838c-4885-bfec-4e2606e212bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d4214e1104483ab4caf5b6fe36b606'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:17.905293 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5df9595c-838c-4885-bfec-4e2606e212bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d4214e1104483ab4caf5b6fe36b606'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:17.908690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] The token cache is being invalidate because project 414cd8578be24455b2823c5c6748c67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:17.909349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:17.915381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:17.929738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1067/2138] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:17 2022] DELETE /identity/v3/projects/414cd8578be24455b2823c5c6748c67c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:17.930958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5df9595c-838c-4885-bfec-4e2606e212bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d4214e1104483ab4caf5b6fe36b606'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:17.931493 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:17.942520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5df9595c-838c-4885-bfec-4e2606e212bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d4214e1104483ab4caf5b6fe36b606'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:17.950847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1072/2139] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:50:17 2022] DELETE /identity/v3/users/19d4214e1104483ab4caf5b6fe36b606 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:17.952507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:17.958846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d414-1057-4392-b497-960c438e420e None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:17.959495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d414-1057-4392-b497-960c438e420e None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:17.960388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d414-1057-4392-b497-960c438e420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:18.004552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a876d414-1057-4392-b497-960c438e420e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:18.006072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a876d414-1057-4392-b497-960c438e420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:18.157707 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1073/2140] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:50:18.171681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d414-1057-4392-b497-960c438e420e None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:18.173695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a876d414-1057-4392-b497-960c438e420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:18.182229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c443-1829-4770-85e8-0b43c731424c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:18.197565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e2cbe-dce1-4628-99a0-d0e3a0716f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:18.198745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e2cbe-dce1-4628-99a0-d0e3a0716f1e admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:18.199139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e2cbe-dce1-4628-99a0-d0e3a0716f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:18.199523 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e2cbe-dce1-4628-99a0-d0e3a0716f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:18.200697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e2cbe-dce1-4628-99a0-d0e3a0716f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:18.202714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e2cbe-dce1-4628-99a0-d0e3a0716f1e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:18.233110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1068/2141] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:18.254954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e2cbe-dce1-4628-99a0-d0e3a0716f1e admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:18.254954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-749e2cbe-dce1-4628-99a0-d0e3a0716f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:18.266678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e2cbe-dce1-4628-99a0-d0e3a0716f1e admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:18.274505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a914f57-a7a4-461c-8035-df1e3701534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:18.275596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a914f57-a7a4-461c-8035-df1e3701534e admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:18.276031 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a914f57-a7a4-461c-8035-df1e3701534e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:18.277337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a914f57-a7a4-461c-8035-df1e3701534e admin admin] PATH_INFO: `/v3/projects/b7c0f4a8f9e04a71a6b71e704c29437a/users/4d2178471fe6400ea4db132f72bc334e/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:18.322454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a914f57-a7a4-461c-8035-df1e3701534e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c0f4a8f9e04a71a6b71e704c29437a, user_id=4d2178471fe6400ea4db132f72bc334e, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:18.328762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a914f57-a7a4-461c-8035-df1e3701534e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:18.394824 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1069/2142] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:50:18 2022] PUT /identity/v3/projects/b7c0f4a8f9e04a71a6b71e704c29437a/users/4d2178471fe6400ea4db132f72bc334e/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:18.400677 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16566ff5-91da-463c-a8c0-89529720a245 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:18.402854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16566ff5-91da-463c-a8c0-89529720a245 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:18.403784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16566ff5-91da-463c-a8c0-89529720a245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:18.417153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d414-1057-4392-b497-960c438e420e None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:18.456756 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-16566ff5-91da-463c-a8c0-89529720a245 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:18.461344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-16566ff5-91da-463c-a8c0-89529720a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:18.532616 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16d224-42d4-4788-b0c0-e464b4596998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:18.533525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16d224-42d4-4788-b0c0-e464b4596998 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:18.534399 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16d224-42d4-4788-b0c0-e464b4596998 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:18.534887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16d224-42d4-4788-b0c0-e464b4596998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:18.569421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1070/2143] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:18.591554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16566ff5-91da-463c-a8c0-89529720a245 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:18.629317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16d224-42d4-4788-b0c0-e464b4596998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:18.632389 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16d224-42d4-4788-b0c0-e464b4596998 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:18.641873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16566ff5-91da-463c-a8c0-89529720a245 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:18.645214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1074/2144] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:18.671879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d0edc-9e8f-4296-8ac8-0626d2ab8420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:18.674484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d0edc-9e8f-4296-8ac8-0626d2ab8420 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:18.674739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ee256-e619-4afa-912b-eb9204f54e0f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:18.674901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d0edc-9e8f-4296-8ac8-0626d2ab8420 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:18.675056 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ee256-e619-4afa-912b-eb9204f54e0f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:18.675554 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ee256-e619-4afa-912b-eb9204f54e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:18.678528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d0edc-9e8f-4296-8ac8-0626d2ab8420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:18.710625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d0edc-9e8f-4296-8ac8-0626d2ab8420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:18.716441 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d0edc-9e8f-4296-8ac8-0626d2ab8420 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:18.718911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-529ee256-e619-4afa-912b-eb9204f54e0f None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:18.720740 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-529ee256-e619-4afa-912b-eb9204f54e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:18.745068 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1071/2145] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:50:18.854876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1075/2146] 10.222.0.72 () {58 vars in 967 bytes} [Mon May 16 18:50:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:50:18.873338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d0edc-9e8f-4296-8ac8-0626d2ab8420 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:18.875222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3f3d0edc-9e8f-4296-8ac8-0626d2ab8420 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:19.014551 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d0edc-9e8f-4296-8ac8-0626d2ab8420 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:19.022350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c466c1-6d29-4a3c-a975-c9790b042c7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:19.023165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c466c1-6d29-4a3c-a975-c9790b042c7b service swift] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:19.023530 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c466c1-6d29-4a3c-a975-c9790b042c7b service swift] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:19.023871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c466c1-6d29-4a3c-a975-c9790b042c7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:19.036446 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c466c1-6d29-4a3c-a975-c9790b042c7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:19.038623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c466c1-6d29-4a3c-a975-c9790b042c7b service swift] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:19.050708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1072/2147] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:50:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:50:20.017422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbde54-5144-4baf-bbe6-8d8492467fcd None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:20.018418 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbde54-5144-4baf-bbe6-8d8492467fcd None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:20.018418 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbde54-5144-4baf-bbe6-8d8492467fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:20.041483 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c466c1-6d29-4a3c-a975-c9790b042c7b service swift] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:20.051673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-61c466c1-6d29-4a3c-a975-c9790b042c7b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:20.085107 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-55dbde54-5144-4baf-bbe6-8d8492467fcd None None] MFA Rules not processed for user `4d2178471fe6400ea4db132f72bc334e`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:20.086349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c466c1-6d29-4a3c-a975-c9790b042c7b service swift] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:20.087044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-55dbde54-5144-4baf-bbe6-8d8492467fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:20.097299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:20.098282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:20.101469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:20.101892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] PATH_INFO: `/v3/projects/c638d227475f4109809eba7eb76e6fbc` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:20.103510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c638d227475f4109809eba7eb76e6fbc)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:20.105839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:20.232327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c638d227475f4109809eba7eb76e6fbc', 'request_id': 'req-4965b9bc-c5ad-4e55-8994-2ed777793970'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:20.260686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c638d227475f4109809eba7eb76e6fbc', 'request_id': 'req-4965b9bc-c5ad-4e55-8994-2ed777793970'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:20.264875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1076/2148] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:20.270355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c638d227475f4109809eba7eb76e6fbc', 'request_id': 'req-4965b9bc-c5ad-4e55-8994-2ed777793970'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:20.284153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] The token cache is being invalidate because project c638d227475f4109809eba7eb76e6fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:20.285024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:20.286385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4965b9bc-c5ad-4e55-8994-2ed777793970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:20.287694 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbde54-5144-4baf-bbe6-8d8492467fcd None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:20.289987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-55dbde54-5144-4baf-bbe6-8d8492467fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:20.292047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1073/2149] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:20 2022] DELETE /identity/v3/projects/c638d227475f4109809eba7eb76e6fbc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:20.294021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e75a-f5eb-4f46-a222-f6d48be85c1e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:20.294332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e75a-f5eb-4f46-a222-f6d48be85c1e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:20.295118 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e75a-f5eb-4f46-a222-f6d48be85c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:20.321943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b355e75a-f5eb-4f46-a222-f6d48be85c1e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:20.323792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b355e75a-f5eb-4f46-a222-f6d48be85c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:20.409928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbde54-5144-4baf-bbe6-8d8492467fcd None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:20.462224 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1074/2150] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:20.474972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb58367-a1f4-4f81-8b06-79ed69f7a292 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:20.475474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb58367-a1f4-4f81-8b06-79ed69f7a292 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:20.476069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb58367-a1f4-4f81-8b06-79ed69f7a292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:20.508411 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-7cb58367-a1f4-4f81-8b06-79ed69f7a292 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:20.511744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7cb58367-a1f4-4f81-8b06-79ed69f7a292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:20.525627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32574a6-1953-47e6-baa2-141b2d211d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:20.526452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32574a6-1953-47e6-baa2-141b2d211d9c service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:20.527001 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32574a6-1953-47e6-baa2-141b2d211d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:20.527346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32574a6-1953-47e6-baa2-141b2d211d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:20.529869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d32574a6-1953-47e6-baa2-141b2d211d9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:20.534166 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1075/2151] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:50:20.541297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb58367-a1f4-4f81-8b06-79ed69f7a292 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:20.561901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb58367-a1f4-4f81-8b06-79ed69f7a292 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:20.575258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebda9fc-fed3-4b84-85b0-2b758a9fe626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:20.576905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebda9fc-fed3-4b84-85b0-2b758a9fe626 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:20.577577 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebda9fc-fed3-4b84-85b0-2b758a9fe626 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:20.578263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebda9fc-fed3-4b84-85b0-2b758a9fe626 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:20.579882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebda9fc-fed3-4b84-85b0-2b758a9fe626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:50:20.581037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebda9fc-fed3-4b84-85b0-2b758a9fe626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:20.584640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebda9fc-fed3-4b84-85b0-2b758a9fe626 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:20.615698 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1076/2152] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:50:20.616598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebda9fc-fed3-4b84-85b0-2b758a9fe626 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:20.632971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebda9fc-fed3-4b84-85b0-2b758a9fe626 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:20.639008 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaeb97-d993-450b-aa31-0154f23a4334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:20.639815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaeb97-d993-450b-aa31-0154f23a4334 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:20.640164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaeb97-d993-450b-aa31-0154f23a4334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:20.640507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaeb97-d993-450b-aa31-0154f23a4334 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:20.641272 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaeb97-d993-450b-aa31-0154f23a4334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:20.643511 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaeb97-d993-450b-aa31-0154f23a4334 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:20.691069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32574a6-1953-47e6-baa2-141b2d211d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:20.693959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32574a6-1953-47e6-baa2-141b2d211d9c service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:20.695865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1077/2153] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:50:20 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:20.701177 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaeb97-d993-450b-aa31-0154f23a4334 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:20.724127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1077/2154] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:20.881343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaeb97-d993-450b-aa31-0154f23a4334 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:20.898693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e71c90-0f43-4ffc-8842-4fc1ad34c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:20.899899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e71c90-0f43-4ffc-8842-4fc1ad34c9da admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:20.900438 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e71c90-0f43-4ffc-8842-4fc1ad34c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:20.900931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e71c90-0f43-4ffc-8842-4fc1ad34c9da admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:20.902237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e71c90-0f43-4ffc-8842-4fc1ad34c9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:20.906917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e71c90-0f43-4ffc-8842-4fc1ad34c9da admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:20.960731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1078/2155] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:50:20 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:20.966904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32574a6-1953-47e6-baa2-141b2d211d9c service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:20.988793 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32574a6-1953-47e6-baa2-141b2d211d9c service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:21.000375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b18ac-5852-4832-bb77-a9c0436463a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:21.002290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b18ac-5852-4832-bb77-a9c0436463a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:21.002695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b18ac-5852-4832-bb77-a9c0436463a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:21.003154 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b18ac-5852-4832-bb77-a9c0436463a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:21.005081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b18ac-5852-4832-bb77-a9c0436463a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:21.011144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b18ac-5852-4832-bb77-a9c0436463a6 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:21.061463 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1078/2156] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:21.068201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e71c90-0f43-4ffc-8842-4fc1ad34c9da admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:21.110803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e71c90-0f43-4ffc-8842-4fc1ad34c9da admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:21.143974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2c5c-db31-43ec-a367-4423e10aec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:21.145328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2c5c-db31-43ec-a367-4423e10aec41 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:21.145905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2c5c-db31-43ec-a367-4423e10aec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:21.146315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2c5c-db31-43ec-a367-4423e10aec41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:21.147032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c2c5c-db31-43ec-a367-4423e10aec41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:21.148745 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c2c5c-db31-43ec-a367-4423e10aec41 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:21.168858 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1079/2157] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:21.176635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b18ac-5852-4832-bb77-a9c0436463a6 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:21.200850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b18ac-5852-4832-bb77-a9c0436463a6 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:21.211629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f472a25-88b8-4533-87b4-56579ea485c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:21.212950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f472a25-88b8-4533-87b4-56579ea485c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:21.213725 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f472a25-88b8-4533-87b4-56579ea485c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:21.213954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f472a25-88b8-4533-87b4-56579ea485c5 admin admin] PATH_INFO: `/v3/projects/d146414476fb4eccbac1b0371a0a53fe/users/06aeac0657c048d5ae82068597843f87/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:21.243271 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f472a25-88b8-4533-87b4-56579ea485c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d146414476fb4eccbac1b0371a0a53fe, user_id=06aeac0657c048d5ae82068597843f87, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:21.246370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f472a25-88b8-4533-87b4-56579ea485c5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:21.269326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1079/2158] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:50:21 2022] PUT /identity/v3/projects/d146414476fb4eccbac1b0371a0a53fe/users/06aeac0657c048d5ae82068597843f87/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:21.282206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f2abd-e3f6-46df-83d3-321d23cd94d0 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:21.282520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f2abd-e3f6-46df-83d3-321d23cd94d0 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:21.282763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f2abd-e3f6-46df-83d3-321d23cd94d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:21.333570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-650f2abd-e3f6-46df-83d3-321d23cd94d0 None None] MFA Rules not processed for user `06aeac0657c048d5ae82068597843f87`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:21.337052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-650f2abd-e3f6-46df-83d3-321d23cd94d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:21.433148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1080/2159] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:21.447750 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f472a25-88b8-4533-87b4-56579ea485c5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:21.449970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1f472a25-88b8-4533-87b4-56579ea485c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:21.522953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f472a25-88b8-4533-87b4-56579ea485c5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:21.528319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415867f-e4f4-487e-965a-41a7fafdd7b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:21.529087 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415867f-e4f4-487e-965a-41a7fafdd7b0 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:21.529417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415867f-e4f4-487e-965a-41a7fafdd7b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:21.529741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415867f-e4f4-487e-965a-41a7fafdd7b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:21.541026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415867f-e4f4-487e-965a-41a7fafdd7b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:21.542733 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415867f-e4f4-487e-965a-41a7fafdd7b0 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:21.554433 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1080/2160] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:21.957289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f2abd-e3f6-46df-83d3-321d23cd94d0 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:21.958855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-650f2abd-e3f6-46df-83d3-321d23cd94d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:22.043427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f2abd-e3f6-46df-83d3-321d23cd94d0 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:22.048455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:22.050570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:22.050868 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:22.051154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] PATH_INFO: `/v3/users/7730774a21ad488cbcd6ad9e89539fb3` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:22.052492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7730774a21ad488cbcd6ad9e89539fb3)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:22.054497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:22.126833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7730774a21ad488cbcd6ad9e89539fb3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:22.146999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7730774a21ad488cbcd6ad9e89539fb3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:22.148368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7730774a21ad488cbcd6ad9e89539fb3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:22.150018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7730774a21ad488cbcd6ad9e89539fb3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:22.159476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7730774a21ad488cbcd6ad9e89539fb3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:22.186255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1081/2161] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:50:21 2022] DELETE /identity/v3/users/7730774a21ad488cbcd6ad9e89539fb3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:50:22.193369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3816bf3-c3bd-4f81-afc9-f00a079f6e2a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:22.194154 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3816bf3-c3bd-4f81-afc9-f00a079f6e2a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:22.194293 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3816bf3-c3bd-4f81-afc9-f00a079f6e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:22.228687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c3816bf3-c3bd-4f81-afc9-f00a079f6e2a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:22.230392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c3816bf3-c3bd-4f81-afc9-f00a079f6e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:22.311951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1081/2162] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:22.323889 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:22.325331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:22.398991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf36a6-403b-4c7a-ab20-74c877b62d90 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:22.404011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9f344-a844-49d5-ae9f-ee03cee7879c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:22.405000 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9f344-a844-49d5-ae9f-ee03cee7879c service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:22.405475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9f344-a844-49d5-ae9f-ee03cee7879c service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:22.405978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9f344-a844-49d5-ae9f-ee03cee7879c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:22.421056 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9f344-a844-49d5-ae9f-ee03cee7879c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:22.423134 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9f344-a844-49d5-ae9f-ee03cee7879c service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:22.443947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1082/2163] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:22.461160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206c9c2-1a0e-43d9-b01d-d554b049432f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:22.461668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206c9c2-1a0e-43d9-b01d-d554b049432f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:22.461889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206c9c2-1a0e-43d9-b01d-d554b049432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:22.487133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d206c9c2-1a0e-43d9-b01d-d554b049432f None None] MFA Rules not processed for user `4d2178471fe6400ea4db132f72bc334e`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:22.488600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d206c9c2-1a0e-43d9-b01d-d554b049432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:22.563449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1082/2164] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:22.663844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9f344-a844-49d5-ae9f-ee03cee7879c service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:22.665410 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-66f9f344-a844-49d5-ae9f-ee03cee7879c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:22.690239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9f344-a844-49d5-ae9f-ee03cee7879c service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:22.695931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:22.697168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:22.697513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:22.697879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] PATH_INFO: `/v3/projects/08dc3aef746542f0944976334e4120f0` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:22.699591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=08dc3aef746542f0944976334e4120f0)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:22.702296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:22.805016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08dc3aef746542f0944976334e4120f0', 'request_id': 'req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:22.816607 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08dc3aef746542f0944976334e4120f0', 'request_id': 'req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:22.826037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08dc3aef746542f0944976334e4120f0', 'request_id': 'req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:22.843391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] The token cache is being invalidate because project 08dc3aef746542f0944976334e4120f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:22.843886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:22.844714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f5ccf159-a86a-4f3a-bd83-4864be0bfe3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:22.847067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1083/2165] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:22 2022] DELETE /identity/v3/projects/08dc3aef746542f0944976334e4120f0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:22.855486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ce98-42e0-4ea6-9034-3902e7690884 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:22.856013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ce98-42e0-4ea6-9034-3902e7690884 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:22.856460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ce98-42e0-4ea6-9034-3902e7690884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:22.890978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2693ce98-42e0-4ea6-9034-3902e7690884 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:22.894171 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2693ce98-42e0-4ea6-9034-3902e7690884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:23.022086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1083/2166] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:23.038435 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5370-fa12-476d-8937-f4843694106c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:23.038865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5370-fa12-476d-8937-f4843694106c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:23.039349 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5370-fa12-476d-8937-f4843694106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:23.065992 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-dd3a5370-fa12-476d-8937-f4843694106c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:23.067226 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-dd3a5370-fa12-476d-8937-f4843694106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:23.077566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1084/2167] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:23.082789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693ce98-42e0-4ea6-9034-3902e7690884 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:23.099423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693ce98-42e0-4ea6-9034-3902e7690884 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:23.110845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626879c-3ca0-47cb-b164-abbf8830f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:23.113291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626879c-3ca0-47cb-b164-abbf8830f970 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:23.113813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626879c-3ca0-47cb-b164-abbf8830f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:23.114340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626879c-3ca0-47cb-b164-abbf8830f970 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:23.115970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626879c-3ca0-47cb-b164-abbf8830f970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:50:23.116589 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626879c-3ca0-47cb-b164-abbf8830f970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:23.124216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626879c-3ca0-47cb-b164-abbf8830f970 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:23.149242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1084/2168] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:50:23.154986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a5370-fa12-476d-8937-f4843694106c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:23.170141 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a5370-fa12-476d-8937-f4843694106c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:23.176021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686edaf6-ba0e-4d2e-b3cf-7bd13af8653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:23.176758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686edaf6-ba0e-4d2e-b3cf-7bd13af8653b admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:23.177033 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686edaf6-ba0e-4d2e-b3cf-7bd13af8653b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:23.177624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686edaf6-ba0e-4d2e-b3cf-7bd13af8653b admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:23.178585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686edaf6-ba0e-4d2e-b3cf-7bd13af8653b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:23.180925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686edaf6-ba0e-4d2e-b3cf-7bd13af8653b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:23.219198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1085/2169] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:50:23 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:23.225101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626879c-3ca0-47cb-b164-abbf8830f970 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:23.238127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626879c-3ca0-47cb-b164-abbf8830f970 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:23.342874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277df59e-70db-4678-9fd3-f479870cf958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:23.343992 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df59e-70db-4678-9fd3-f479870cf958 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:23.344434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df59e-70db-4678-9fd3-f479870cf958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:23.344704 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df59e-70db-4678-9fd3-f479870cf958 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:23.345881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277df59e-70db-4678-9fd3-f479870cf958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:23.348850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277df59e-70db-4678-9fd3-f479870cf958 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:23.378979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1085/2170] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:50:23 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:50:23.386210 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686edaf6-ba0e-4d2e-b3cf-7bd13af8653b admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:23.404267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686edaf6-ba0e-4d2e-b3cf-7bd13af8653b admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:23.412076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a4fe3-dd0d-414f-b12e-3aed7565e9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:23.413966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a4fe3-dd0d-414f-b12e-3aed7565e9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:23.414493 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a4fe3-dd0d-414f-b12e-3aed7565e9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:23.414996 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a4fe3-dd0d-414f-b12e-3aed7565e9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:23.416455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a4fe3-dd0d-414f-b12e-3aed7565e9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:23.419283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a4fe3-dd0d-414f-b12e-3aed7565e9f0 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:23.436918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1086/2171] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:23.438594 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277df59e-70db-4678-9fd3-f479870cf958 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:23.451895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277df59e-70db-4678-9fd3-f479870cf958 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:23.459083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd79476-bbe8-4745-8f1d-0222e96ab8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:23.460115 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd79476-bbe8-4745-8f1d-0222e96ab8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:23.460388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd79476-bbe8-4745-8f1d-0222e96ab8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:23.460914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd79476-bbe8-4745-8f1d-0222e96ab8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:23.461674 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd79476-bbe8-4745-8f1d-0222e96ab8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:23.463541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd79476-bbe8-4745-8f1d-0222e96ab8d0 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:23.487623 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1086/2172] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:23.492771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a4fe3-dd0d-414f-b12e-3aed7565e9f0 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:23.514878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a4fe3-dd0d-414f-b12e-3aed7565e9f0 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:23.524943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e46243-7e12-4add-a277-4caf706ab930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:23.526016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e46243-7e12-4add-a277-4caf706ab930 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:23.526513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e46243-7e12-4add-a277-4caf706ab930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:23.526809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e46243-7e12-4add-a277-4caf706ab930 admin admin] PATH_INFO: `/v3/projects/405413536bdb433fbb7d03c8ccd34283/users/258580b81cf0480d9728500884442b55/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:23.554976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e46243-7e12-4add-a277-4caf706ab930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405413536bdb433fbb7d03c8ccd34283, user_id=258580b81cf0480d9728500884442b55, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:23.561637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e46243-7e12-4add-a277-4caf706ab930 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:23.583145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1087/2173] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:50:23 2022] PUT /identity/v3/projects/405413536bdb433fbb7d03c8ccd34283/users/258580b81cf0480d9728500884442b55/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:23.590842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7805e-0a2e-4214-991f-e595f7b94fd9 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:23.591740 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7805e-0a2e-4214-991f-e595f7b94fd9 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:23.592153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7805e-0a2e-4214-991f-e595f7b94fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:23.620746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-1cb7805e-0a2e-4214-991f-e595f7b94fd9 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:23.622185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1cb7805e-0a2e-4214-991f-e595f7b94fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:23.718330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1087/2174] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:50:23.730376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e46243-7e12-4add-a277-4caf706ab930 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:23.732359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-18e46243-7e12-4add-a277-4caf706ab930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:23.808661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e46243-7e12-4add-a277-4caf706ab930 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:23.813764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2021553-3613-4689-9ea0-71bf029018e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:23.814915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2021553-3613-4689-9ea0-71bf029018e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:23.815074 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2021553-3613-4689-9ea0-71bf029018e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:23.815405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2021553-3613-4689-9ea0-71bf029018e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:23.828673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2021553-3613-4689-9ea0-71bf029018e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:23.831401 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2021553-3613-4689-9ea0-71bf029018e4 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:23.842981 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1088/2175] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:28.996691 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5592aa-513d-4763-ad74-a030ed2d3f0f None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:28.996691 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5592aa-513d-4763-ad74-a030ed2d3f0f None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:28.997203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5592aa-513d-4763-ad74-a030ed2d3f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:29.032337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-ba5592aa-513d-4763-ad74-a030ed2d3f0f None None] MFA Rules not processed for user `258580b81cf0480d9728500884442b55`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:29.033920 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ba5592aa-513d-4763-ad74-a030ed2d3f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:29.125104 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1088/2176] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:29.130667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2021553-3613-4689-9ea0-71bf029018e4 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:29.142580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2021553-3613-4689-9ea0-71bf029018e4 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:29.148656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25934ac4-097b-404b-a497-db8ce8088420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:29.151174 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934ac4-097b-404b-a497-db8ce8088420 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:29.151570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934ac4-097b-404b-a497-db8ce8088420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:29.151958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934ac4-097b-404b-a497-db8ce8088420 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:29.152761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25934ac4-097b-404b-a497-db8ce8088420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:29.154814 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25934ac4-097b-404b-a497-db8ce8088420 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:29.184391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1089/2177] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:50:29 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:29.188397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5592aa-513d-4763-ad74-a030ed2d3f0f None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:29.200107 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5592aa-513d-4763-ad74-a030ed2d3f0f None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:29.265557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e0fdd-7db5-4523-9903-afe188789030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:29.266164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e0fdd-7db5-4523-9903-afe188789030 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:29.266447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e0fdd-7db5-4523-9903-afe188789030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:29.266826 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e0fdd-7db5-4523-9903-afe188789030 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:29.267539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e0fdd-7db5-4523-9903-afe188789030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:29.269533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e0fdd-7db5-4523-9903-afe188789030 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:29.291435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1089/2178] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:50:29 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:29.295687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25934ac4-097b-404b-a497-db8ce8088420 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:29.307179 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25934ac4-097b-404b-a497-db8ce8088420 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:29.312242 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222df425-96d0-4e5b-a8b7-cee04b3ffec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:29.312939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222df425-96d0-4e5b-a8b7-cee04b3ffec2 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:29.313229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222df425-96d0-4e5b-a8b7-cee04b3ffec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:29.313511 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222df425-96d0-4e5b-a8b7-cee04b3ffec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:29.314784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222df425-96d0-4e5b-a8b7-cee04b3ffec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:29.317557 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222df425-96d0-4e5b-a8b7-cee04b3ffec2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:29.330388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1090/2179] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:29.334895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e0fdd-7db5-4523-9903-afe188789030 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:29.346775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e0fdd-7db5-4523-9903-afe188789030 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:29.352225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b848ba9-baf1-4cf3-9343-dc8de04042bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:29.353151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b848ba9-baf1-4cf3-9343-dc8de04042bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:29.353437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b848ba9-baf1-4cf3-9343-dc8de04042bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:29.353717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b848ba9-baf1-4cf3-9343-dc8de04042bf admin admin] PATH_INFO: `/v3/projects/73c1fb9d0eea4b9babc12af8a2e1f714/users/8ab482a96b4c43c9b418200d0b44ba05/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:29.371090 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b848ba9-baf1-4cf3-9343-dc8de04042bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c1fb9d0eea4b9babc12af8a2e1f714, user_id=8ab482a96b4c43c9b418200d0b44ba05, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:29.373744 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b848ba9-baf1-4cf3-9343-dc8de04042bf admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:29.390493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1090/2180] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:50:29 2022] PUT /identity/v3/projects/73c1fb9d0eea4b9babc12af8a2e1f714/users/8ab482a96b4c43c9b418200d0b44ba05/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:29.395076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222df425-96d0-4e5b-a8b7-cee04b3ffec2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:29.407034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222df425-96d0-4e5b-a8b7-cee04b3ffec2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:29.508396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fd30d-56a1-4496-ae45-47e4d68879b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:29.509071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fd30d-56a1-4496-ae45-47e4d68879b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:29.509352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fd30d-56a1-4496-ae45-47e4d68879b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:29.509628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fd30d-56a1-4496-ae45-47e4d68879b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:29.510358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fd30d-56a1-4496-ae45-47e4d68879b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:29.512002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fd30d-56a1-4496-ae45-47e4d68879b8 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:29.529081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1091/2181] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:29.533323 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b848ba9-baf1-4cf3-9343-dc8de04042bf admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:29.544618 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b848ba9-baf1-4cf3-9343-dc8de04042bf admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:29.551040 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a987-60d4-42d5-abad-0549e9159101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:29.552092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a987-60d4-42d5-abad-0549e9159101 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:29.552381 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a987-60d4-42d5-abad-0549e9159101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:29.552684 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430a987-60d4-42d5-abad-0549e9159101 admin admin] PATH_INFO: `/v3/projects/73c1fb9d0eea4b9babc12af8a2e1f714/users/8ab482a96b4c43c9b418200d0b44ba05/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:29.554799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430a987-60d4-42d5-abad-0549e9159101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c1fb9d0eea4b9babc12af8a2e1f714, user_id=8ab482a96b4c43c9b418200d0b44ba05, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:29.557604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430a987-60d4-42d5-abad-0549e9159101 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:29.570174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1091/2182] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:50:29 2022] PUT /identity/v3/projects/73c1fb9d0eea4b9babc12af8a2e1f714/users/8ab482a96b4c43c9b418200d0b44ba05/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:37.102297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f94a12-41d7-498b-b3c7-4bb47f7909b8 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:37.103173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f94a12-41d7-498b-b3c7-4bb47f7909b8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:37.103606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f94a12-41d7-498b-b3c7-4bb47f7909b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:37.196818 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d5f94a12-41d7-498b-b3c7-4bb47f7909b8 None None] MFA Rules not processed for user `8ab482a96b4c43c9b418200d0b44ba05`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:37.199185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d5f94a12-41d7-498b-b3c7-4bb47f7909b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:37.362359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1092/2183] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:37.377420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a987-60d4-42d5-abad-0549e9159101 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:37.381742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c430a987-60d4-42d5-abad-0549e9159101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:37.570881 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430a987-60d4-42d5-abad-0549e9159101 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:37.577536 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cbe58-55c4-4cc6-83e2-8db617251c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:37.578211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cbe58-55c4-4cc6-83e2-8db617251c4f service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:37.578490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cbe58-55c4-4cc6-83e2-8db617251c4f service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:37.578768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cbe58-55c4-4cc6-83e2-8db617251c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:37.656367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cbe58-55c4-4cc6-83e2-8db617251c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:37.659873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cbe58-55c4-4cc6-83e2-8db617251c4f service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:37.679110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1092/2184] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:39.145242 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897f2b8-62dd-4543-b03e-01fe4c00b6e8 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:39.145878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897f2b8-62dd-4543-b03e-01fe4c00b6e8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:39.145878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897f2b8-62dd-4543-b03e-01fe4c00b6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:39.163366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f897f2b8-62dd-4543-b03e-01fe4c00b6e8 None None] MFA Rules not processed for user `258580b81cf0480d9728500884442b55`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:39.164622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f897f2b8-62dd-4543-b03e-01fe4c00b6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:39.171995 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1093/2185] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:44.934732 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cbe58-55c4-4cc6-83e2-8db617251c4f service nova] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:44.936364 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8e3cbe58-55c4-4cc6-83e2-8db617251c4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:45.101388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cbe58-55c4-4cc6-83e2-8db617251c4f service nova] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:45.109057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:45.110552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:45.111556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:45.112089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] PATH_INFO: `/v3/users/06aeac0657c048d5ae82068597843f87` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:45.114244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] RBAC: Authorizing `identity:delete_user(user_id=06aeac0657c048d5ae82068597843f87)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:45.117808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:45.207531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06aeac0657c048d5ae82068597843f87'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:45.229502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06aeac0657c048d5ae82068597843f87'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:45.230287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06aeac0657c048d5ae82068597843f87'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:45.238975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06aeac0657c048d5ae82068597843f87'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:45.248055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06aeac0657c048d5ae82068597843f87'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:45.255543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1093/2186] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:50:44 2022] DELETE /identity/v3/users/06aeac0657c048d5ae82068597843f87 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:45.260247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e925b0-f284-4af3-989b-f1a9635fcd87 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:45.260829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e925b0-f284-4af3-989b-f1a9635fcd87 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:45.260829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e925b0-f284-4af3-989b-f1a9635fcd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:45.309936 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b1e925b0-f284-4af3-989b-f1a9635fcd87 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:45.312145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b1e925b0-f284-4af3-989b-f1a9635fcd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:45.435814 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1094/2187] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:50:45.444344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:45.446404 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:45.568657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e735c8-9386-401c-b839-df24de5a06df admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:45.574753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b876e-63f4-478c-a275-29072a632116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:45.575567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b876e-63f4-478c-a275-29072a632116 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:45.576089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b876e-63f4-478c-a275-29072a632116 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:45.577221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b876e-63f4-478c-a275-29072a632116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:45.589416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b876e-63f4-478c-a275-29072a632116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:45.590871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b876e-63f4-478c-a275-29072a632116 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:45.602283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1094/2188] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:45.985303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e925b0-f284-4af3-989b-f1a9635fcd87 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:45.989649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b1e925b0-f284-4af3-989b-f1a9635fcd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:46.004153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e925b0-f284-4af3-989b-f1a9635fcd87 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:46.009489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:46.010792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:46.011130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:46.011603 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] PATH_INFO: `/v3/projects/d146414476fb4eccbac1b0371a0a53fe` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:46.013040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d146414476fb4eccbac1b0371a0a53fe)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:46.015662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:46.095809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd146414476fb4eccbac1b0371a0a53fe', 'request_id': 'req-5cddc63b-a918-4f31-b71c-a6376315e4cb'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:46.107200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd146414476fb4eccbac1b0371a0a53fe', 'request_id': 'req-5cddc63b-a918-4f31-b71c-a6376315e4cb'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:46.118512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd146414476fb4eccbac1b0371a0a53fe', 'request_id': 'req-5cddc63b-a918-4f31-b71c-a6376315e4cb'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:46.140944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] The token cache is being invalidate because project d146414476fb4eccbac1b0371a0a53fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:46.140944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:46.141393 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5cddc63b-a918-4f31-b71c-a6376315e4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:46.150569 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1095/2189] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:45 2022] DELETE /identity/v3/projects/d146414476fb4eccbac1b0371a0a53fe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:46.155681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331dc7-d686-4aa0-a08f-ef3aa3033dd4 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:46.157272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331dc7-d686-4aa0-a08f-ef3aa3033dd4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:46.158068 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331dc7-d686-4aa0-a08f-ef3aa3033dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:46.214689 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-b0331dc7-d686-4aa0-a08f-ef3aa3033dd4 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:46.216083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b0331dc7-d686-4aa0-a08f-ef3aa3033dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:46.331521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1095/2190] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:46.337532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b62c72-f173-40e4-9cfa-d0f1eb52fef6 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:46.338350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b62c72-f173-40e4-9cfa-d0f1eb52fef6 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:46.338646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b62c72-f173-40e4-9cfa-d0f1eb52fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:46.369921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-02b62c72-f173-40e4-9cfa-d0f1eb52fef6 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:46.371461 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-02b62c72-f173-40e4-9cfa-d0f1eb52fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:46.382773 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1096/2191] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:46.389714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331dc7-d686-4aa0-a08f-ef3aa3033dd4 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:46.402736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331dc7-d686-4aa0-a08f-ef3aa3033dd4 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:46.408975 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388a63c-ab73-4faf-b7e5-c5fc27e56ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:46.410069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388a63c-ab73-4faf-b7e5-c5fc27e56ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:46.410499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388a63c-ab73-4faf-b7e5-c5fc27e56ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:46.410847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388a63c-ab73-4faf-b7e5-c5fc27e56ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:46.411973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388a63c-ab73-4faf-b7e5-c5fc27e56ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:50:46.412437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388a63c-ab73-4faf-b7e5-c5fc27e56ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:46.414664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388a63c-ab73-4faf-b7e5-c5fc27e56ee0 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:46.444407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1096/2192] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:50:46.447067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b62c72-f173-40e4-9cfa-d0f1eb52fef6 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:46.468169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b62c72-f173-40e4-9cfa-d0f1eb52fef6 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:46.475550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68960ac-8551-49aa-9198-bac33e9222b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:46.476621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68960ac-8551-49aa-9198-bac33e9222b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:46.477055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68960ac-8551-49aa-9198-bac33e9222b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:46.477461 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68960ac-8551-49aa-9198-bac33e9222b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:46.478339 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68960ac-8551-49aa-9198-bac33e9222b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:46.480813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68960ac-8551-49aa-9198-bac33e9222b9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:46.519474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1097/2193] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:50:46 2022] POST /identity/v3/projects => generated 399 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:46.524118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388a63c-ab73-4faf-b7e5-c5fc27e56ee0 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:46.536952 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388a63c-ab73-4faf-b7e5-c5fc27e56ee0 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:46.624928 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feb7ab-49c2-4c1e-a635-75b4baf6e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:46.625778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feb7ab-49c2-4c1e-a635-75b4baf6e01c admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:46.626190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feb7ab-49c2-4c1e-a635-75b4baf6e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:46.626557 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feb7ab-49c2-4c1e-a635-75b4baf6e01c admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:46.627683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9feb7ab-49c2-4c1e-a635-75b4baf6e01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:46.630188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9feb7ab-49c2-4c1e-a635-75b4baf6e01c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:46.653103 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1097/2194] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:50:46 2022] POST /identity/v3/users => generated 300 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:50:46.658016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68960ac-8551-49aa-9198-bac33e9222b9 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:46.672942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68960ac-8551-49aa-9198-bac33e9222b9 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:46.683178 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f043f-23b3-4d4f-96f8-c133b4dbebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:46.683178 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f043f-23b3-4d4f-96f8-c133b4dbebab admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:46.683500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f043f-23b3-4d4f-96f8-c133b4dbebab admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:46.683777 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f043f-23b3-4d4f-96f8-c133b4dbebab admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:46.685110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f043f-23b3-4d4f-96f8-c133b4dbebab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:46.688241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f043f-23b3-4d4f-96f8-c133b4dbebab admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:46.708152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1098/2195] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:46.715267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feb7ab-49c2-4c1e-a635-75b4baf6e01c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:46.728788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feb7ab-49c2-4c1e-a635-75b4baf6e01c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:46.734872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13950c7d-167d-4830-aaa2-774c2742111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:46.735763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13950c7d-167d-4830-aaa2-774c2742111b admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:46.736054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13950c7d-167d-4830-aaa2-774c2742111b admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:46.736333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13950c7d-167d-4830-aaa2-774c2742111b admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:46.737613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13950c7d-167d-4830-aaa2-774c2742111b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:46.740472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13950c7d-167d-4830-aaa2-774c2742111b admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:46.757718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1098/2196] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:46.763451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f043f-23b3-4d4f-96f8-c133b4dbebab admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:46.777623 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f043f-23b3-4d4f-96f8-c133b4dbebab admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:46.783861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae4e91-fc54-4103-84ec-0741b30e208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:46.784850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae4e91-fc54-4103-84ec-0741b30e208b admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:46.785252 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae4e91-fc54-4103-84ec-0741b30e208b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:46.785627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae4e91-fc54-4103-84ec-0741b30e208b admin admin] PATH_INFO: `/v3/projects/dba2727f36a246a5b5541aac2af7fc0b/users/9e41a63c58294bd687ebcbc97f15dea6/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:46.808338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae4e91-fc54-4103-84ec-0741b30e208b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba2727f36a246a5b5541aac2af7fc0b, user_id=9e41a63c58294bd687ebcbc97f15dea6, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:46.814554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae4e91-fc54-4103-84ec-0741b30e208b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:46.843888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1099/2197] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:50:46 2022] PUT /identity/v3/projects/dba2727f36a246a5b5541aac2af7fc0b/users/9e41a63c58294bd687ebcbc97f15dea6/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:46.866143 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acede4-1608-4f77-ba59-8a2e5f720290 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:46.866784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acede4-1608-4f77-ba59-8a2e5f720290 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:46.867349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acede4-1608-4f77-ba59-8a2e5f720290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:46.909082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d3acede4-1608-4f77-ba59-8a2e5f720290 None None] MFA Rules not processed for user `9e41a63c58294bd687ebcbc97f15dea6`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:46.918064 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d3acede4-1608-4f77-ba59-8a2e5f720290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:47.013127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1099/2198] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:47.029558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae4e91-fc54-4103-84ec-0741b30e208b admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:47.031346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9eae4e91-fc54-4103-84ec-0741b30e208b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:47.102863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae4e91-fc54-4103-84ec-0741b30e208b admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:47.106890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65f565-6aea-4be7-9c01-4470f85d3a3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:47.107660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f565-6aea-4be7-9c01-4470f85d3a3f service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:47.108040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f565-6aea-4be7-9c01-4470f85d3a3f service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:47.108389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f565-6aea-4be7-9c01-4470f85d3a3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:47.118825 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65f565-6aea-4be7-9c01-4470f85d3a3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:47.120479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65f565-6aea-4be7-9c01-4470f85d3a3f service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:47.131277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1100/2199] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:50:55.821087 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acede4-1608-4f77-ba59-8a2e5f720290 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:56.044696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acede4-1608-4f77-ba59-8a2e5f720290 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:56.054606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:56.056347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:56.056707 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:56.058081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] PATH_INFO: `/v3/users/9e41a63c58294bd687ebcbc97f15dea6` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:56.067150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e41a63c58294bd687ebcbc97f15dea6)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:56.068391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:56.180015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e41a63c58294bd687ebcbc97f15dea6'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:56.215334 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e41a63c58294bd687ebcbc97f15dea6'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:56.216952 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e41a63c58294bd687ebcbc97f15dea6'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:56.259940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e41a63c58294bd687ebcbc97f15dea6'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:56.273649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e41a63c58294bd687ebcbc97f15dea6'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:56.288811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1100/2200] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:50:55 2022] DELETE /identity/v3/users/9e41a63c58294bd687ebcbc97f15dea6 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:56.289135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73eabf-da5e-43ce-bed7-0fc2664361c4 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:56.291621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73eabf-da5e-43ce-bed7-0fc2664361c4 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:56.293040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73eabf-da5e-43ce-bed7-0fc2664361c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:56.380808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-2a73eabf-da5e-43ce-bed7-0fc2664361c4 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:56.382185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2a73eabf-da5e-43ce-bed7-0fc2664361c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:56.537693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1101/2201] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:56.552756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:56.554856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:56.660402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35017c3-b798-4340-97fc-56ccb1adebd4 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:56.664534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b9931-6959-4983-a1d0-41396f3dee48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:56.665213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b9931-6959-4983-a1d0-41396f3dee48 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:56.665495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b9931-6959-4983-a1d0-41396f3dee48 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:56.665787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b9931-6959-4983-a1d0-41396f3dee48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:56.687572 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b9931-6959-4983-a1d0-41396f3dee48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:56.689958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b9931-6959-4983-a1d0-41396f3dee48 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:56.701968 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1101/2202] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:50:57.143539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73eabf-da5e-43ce-bed7-0fc2664361c4 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:57.145206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2a73eabf-da5e-43ce-bed7-0fc2664361c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:57.160356 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73eabf-da5e-43ce-bed7-0fc2664361c4 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:57.166175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:57.167518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:57.168038 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:57.168534 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] PATH_INFO: `/v3/projects/dba2727f36a246a5b5541aac2af7fc0b` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:57.171773 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba2727f36a246a5b5541aac2af7fc0b)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:57.174819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:57.255918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba2727f36a246a5b5541aac2af7fc0b', 'request_id': 'req-77652caf-7265-41fe-9089-1c2fce3b8135'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:57.266302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba2727f36a246a5b5541aac2af7fc0b', 'request_id': 'req-77652caf-7265-41fe-9089-1c2fce3b8135'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:57.277810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba2727f36a246a5b5541aac2af7fc0b', 'request_id': 'req-77652caf-7265-41fe-9089-1c2fce3b8135'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:57.292998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] The token cache is being invalidate because project dba2727f36a246a5b5541aac2af7fc0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:50:57.293990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:57.294338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-77652caf-7265-41fe-9089-1c2fce3b8135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:50:57.296910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1102/2203] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:50:57 2022] DELETE /identity/v3/projects/dba2727f36a246a5b5541aac2af7fc0b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:57.305719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce68db-f8d3-4a16-8e62-1e9a70c3f7c1 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:57.306758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce68db-f8d3-4a16-8e62-1e9a70c3f7c1 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:57.307050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce68db-f8d3-4a16-8e62-1e9a70c3f7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:57.348218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-edce68db-f8d3-4a16-8e62-1e9a70c3f7c1 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:57.349782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-edce68db-f8d3-4a16-8e62-1e9a70c3f7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:57.447983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1102/2204] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:57.458293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845dad3-0695-473b-bea5-6de7adf2a62e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:57.458680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845dad3-0695-473b-bea5-6de7adf2a62e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:57.458967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845dad3-0695-473b-bea5-6de7adf2a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:57.497460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-e845dad3-0695-473b-bea5-6de7adf2a62e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:57.498784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e845dad3-0695-473b-bea5-6de7adf2a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:57.510795 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1103/2205] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:57.516620 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce68db-f8d3-4a16-8e62-1e9a70c3f7c1 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:57.539529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce68db-f8d3-4a16-8e62-1e9a70c3f7c1 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:57.551296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84280719-2aa0-4c73-8436-b8a3a4543301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:57.552261 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84280719-2aa0-4c73-8436-b8a3a4543301 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:57.552802 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84280719-2aa0-4c73-8436-b8a3a4543301 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:57.553089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84280719-2aa0-4c73-8436-b8a3a4543301 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:57.553863 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84280719-2aa0-4c73-8436-b8a3a4543301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:50:57.554180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84280719-2aa0-4c73-8436-b8a3a4543301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:57.556158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84280719-2aa0-4c73-8436-b8a3a4543301 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:57.582134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1103/2206] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:50:57.589174 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845dad3-0695-473b-bea5-6de7adf2a62e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:57.601123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845dad3-0695-473b-bea5-6de7adf2a62e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:57.606416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a537b0a-4928-4db9-963c-21affbc1a7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:57.607102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a537b0a-4928-4db9-963c-21affbc1a7bb admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:57.607845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a537b0a-4928-4db9-963c-21affbc1a7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:57.608184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a537b0a-4928-4db9-963c-21affbc1a7bb admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:57.608910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a537b0a-4928-4db9-963c-21affbc1a7bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:57.611185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a537b0a-4928-4db9-963c-21affbc1a7bb admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:57.657205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1104/2207] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:50:57 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:50:57.662105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84280719-2aa0-4c73-8436-b8a3a4543301 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:57.682006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84280719-2aa0-4c73-8436-b8a3a4543301 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:57.791272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abc4c7-d4da-4f6a-ac35-b82e562d7d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:57.792190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abc4c7-d4da-4f6a-ac35-b82e562d7d7e admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:57.792678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abc4c7-d4da-4f6a-ac35-b82e562d7d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:57.793166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abc4c7-d4da-4f6a-ac35-b82e562d7d7e admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:57.794328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abc4c7-d4da-4f6a-ac35-b82e562d7d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:57.797359 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abc4c7-d4da-4f6a-ac35-b82e562d7d7e admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:57.847793 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1104/2208] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:50:57 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:50:57.850803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a537b0a-4928-4db9-963c-21affbc1a7bb admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:57.866279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a537b0a-4928-4db9-963c-21affbc1a7bb admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:57.875172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738c334-ad99-4e97-be0d-29c9860a2977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:57.877524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738c334-ad99-4e97-be0d-29c9860a2977 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:57.878029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738c334-ad99-4e97-be0d-29c9860a2977 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:57.878536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738c334-ad99-4e97-be0d-29c9860a2977 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:57.880035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738c334-ad99-4e97-be0d-29c9860a2977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:57.882013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738c334-ad99-4e97-be0d-29c9860a2977 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:57.894586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1105/2209] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:57.899522 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abc4c7-d4da-4f6a-ac35-b82e562d7d7e admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:57.916396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abc4c7-d4da-4f6a-ac35-b82e562d7d7e admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:57.921945 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2e39c-b3f6-4e33-984c-02119b70f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:57.923282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2e39c-b3f6-4e33-984c-02119b70f416 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:57.923785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2e39c-b3f6-4e33-984c-02119b70f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:57.924161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2e39c-b3f6-4e33-984c-02119b70f416 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:57.924904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2e39c-b3f6-4e33-984c-02119b70f416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:57.926563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2e39c-b3f6-4e33-984c-02119b70f416 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:57.941302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1105/2210] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:50:57.945666 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738c334-ad99-4e97-be0d-29c9860a2977 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:57.957038 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738c334-ad99-4e97-be0d-29c9860a2977 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:57.964522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe153e-64fc-4fb7-b6e9-a11d10aefdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:57.965727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe153e-64fc-4fb7-b6e9-a11d10aefdd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:57.966024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe153e-64fc-4fb7-b6e9-a11d10aefdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:57.966315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe153e-64fc-4fb7-b6e9-a11d10aefdd1 admin admin] PATH_INFO: `/v3/projects/5b168bfd42a645269b47c98f4210e4aa/users/5e9ebfaac4984817bb768476ef74445c/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:57.991918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe153e-64fc-4fb7-b6e9-a11d10aefdd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b168bfd42a645269b47c98f4210e4aa, user_id=5e9ebfaac4984817bb768476ef74445c, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:57.997386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe153e-64fc-4fb7-b6e9-a11d10aefdd1 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:58.018684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1106/2211] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:50:57 2022] PUT /identity/v3/projects/5b168bfd42a645269b47c98f4210e4aa/users/5e9ebfaac4984817bb768476ef74445c/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:50:58.025836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4f26-f6e3-4a19-8b7b-c19d6d0f1834 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:58.026312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4f26-f6e3-4a19-8b7b-c19d6d0f1834 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:58.026835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc4f26-f6e3-4a19-8b7b-c19d6d0f1834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:58.048166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-7fcc4f26-f6e3-4a19-8b7b-c19d6d0f1834 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:58.049552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7fcc4f26-f6e3-4a19-8b7b-c19d6d0f1834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:58.147498 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1106/2212] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:50:58.158299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe153e-64fc-4fb7-b6e9-a11d10aefdd1 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:50:58.161387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-8efe153e-64fc-4fb7-b6e9-a11d10aefdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:58.253503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe153e-64fc-4fb7-b6e9-a11d10aefdd1 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:50:58.259223 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf0a37-9594-4a15-9648-f9db7967dcec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:50:58.259980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf0a37-9594-4a15-9648-f9db7967dcec service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:58.260406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf0a37-9594-4a15-9648-f9db7967dcec service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:58.260692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf0a37-9594-4a15-9648-f9db7967dcec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:58.271381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf0a37-9594-4a15-9648-f9db7967dcec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:50:58.272886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf0a37-9594-4a15-9648-f9db7967dcec service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:50:58.284090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1107/2213] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:50:58.996458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c308ad-68ea-4f08-a97f-a501f9cbffbc None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:50:58.997049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c308ad-68ea-4f08-a97f-a501f9cbffbc None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:50:58.997158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c308ad-68ea-4f08-a97f-a501f9cbffbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:50:59.051111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-69c308ad-68ea-4f08-a97f-a501f9cbffbc None None] MFA Rules not processed for user `4d2178471fe6400ea4db132f72bc334e`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:50:59.052739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-69c308ad-68ea-4f08-a97f-a501f9cbffbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:50:59.174223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1107/2214] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:50:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:51:04.862994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135c33-b48f-4fa6-a6e7-47666679f58e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:04.864778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135c33-b48f-4fa6-a6e7-47666679f58e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:04.865272 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135c33-b48f-4fa6-a6e7-47666679f58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:04.947312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-6c135c33-b48f-4fa6-a6e7-47666679f58e None None] MFA Rules not processed for user `cd0d8acbe24d410690470e3d9d4882b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:51:04.950797 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-6c135c33-b48f-4fa6-a6e7-47666679f58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:05.078122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1108/2215] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:51:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:51:08.108735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf0b08-f60a-4817-801f-e89f1235136c None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:08.109315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf0b08-f60a-4817-801f-e89f1235136c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:08.110423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf0b08-f60a-4817-801f-e89f1235136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:08.169706 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-3ddf0b08-f60a-4817-801f-e89f1235136c None None] MFA Rules not processed for user `5e9ebfaac4984817bb768476ef74445c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:51:08.171903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3ddf0b08-f60a-4817-801f-e89f1235136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:08.310447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1108/2216] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:51:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:51:08.316144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c135c33-b48f-4fa6-a6e7-47666679f58e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:08.341254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c135c33-b48f-4fa6-a6e7-47666679f58e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:08.358752 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8c500-5ed1-4e2d-8aa6-35b6f2b8cb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:08.362956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8c500-5ed1-4e2d-8aa6-35b6f2b8cb0e admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:08.364153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8c500-5ed1-4e2d-8aa6-35b6f2b8cb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:08.367131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8c500-5ed1-4e2d-8aa6-35b6f2b8cb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:08.370460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8c500-5ed1-4e2d-8aa6-35b6f2b8cb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:08.382702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8c500-5ed1-4e2d-8aa6-35b6f2b8cb0e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:08.482409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1109/2217] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:51:08 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:51:08.489071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf0b08-f60a-4817-801f-e89f1235136c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:08.520336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf0b08-f60a-4817-801f-e89f1235136c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:08.638994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c622e15-df73-4a7b-908e-4c01d48453b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:08.640211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c622e15-df73-4a7b-908e-4c01d48453b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:08.640551 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c622e15-df73-4a7b-908e-4c01d48453b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:08.640916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c622e15-df73-4a7b-908e-4c01d48453b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:08.642156 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c622e15-df73-4a7b-908e-4c01d48453b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:08.644271 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c622e15-df73-4a7b-908e-4c01d48453b6 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:08.674654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1109/2218] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:51:08 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:51:08.683641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8c500-5ed1-4e2d-8aa6-35b6f2b8cb0e admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:08.697427 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8c500-5ed1-4e2d-8aa6-35b6f2b8cb0e admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:08.713534 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76869a-85c9-4f34-8e19-23d518356261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:08.714251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76869a-85c9-4f34-8e19-23d518356261 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:08.714554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76869a-85c9-4f34-8e19-23d518356261 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:08.714849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76869a-85c9-4f34-8e19-23d518356261 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:08.715829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76869a-85c9-4f34-8e19-23d518356261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:08.717522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76869a-85c9-4f34-8e19-23d518356261 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:08.732261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1110/2219] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:51:08.739390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c622e15-df73-4a7b-908e-4c01d48453b6 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:08.751825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c622e15-df73-4a7b-908e-4c01d48453b6 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:08.757611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506691-26dd-4e04-b81b-37188473341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:08.758539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506691-26dd-4e04-b81b-37188473341d admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:08.758859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506691-26dd-4e04-b81b-37188473341d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:08.759088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506691-26dd-4e04-b81b-37188473341d admin admin] PATH_INFO: `/v3/projects/180f3443a6cc4812925d74f53babf199/users/a7f186a204be4043b7179f90a6957e51/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:08.779500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d506691-26dd-4e04-b81b-37188473341d admin admin] RBAC: Authorizing `identity:create_grant(project_id=180f3443a6cc4812925d74f53babf199, user_id=a7f186a204be4043b7179f90a6957e51, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:08.783660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d506691-26dd-4e04-b81b-37188473341d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:08.805209 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1110/2220] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:51:08 2022] PUT /identity/v3/projects/180f3443a6cc4812925d74f53babf199/users/a7f186a204be4043b7179f90a6957e51/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:51:08.809698 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76869a-85c9-4f34-8e19-23d518356261 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:08.829437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76869a-85c9-4f34-8e19-23d518356261 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:08.937496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17084a12-b90e-4f1e-ac9e-0c1c39e0acd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:08.939011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084a12-b90e-4f1e-ac9e-0c1c39e0acd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:08.939476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084a12-b90e-4f1e-ac9e-0c1c39e0acd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:08.940423 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17084a12-b90e-4f1e-ac9e-0c1c39e0acd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:08.941786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17084a12-b90e-4f1e-ac9e-0c1c39e0acd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:08.946038 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17084a12-b90e-4f1e-ac9e-0c1c39e0acd0 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:08.977298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1111/2221] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:51:08.983822 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506691-26dd-4e04-b81b-37188473341d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:09.006496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506691-26dd-4e04-b81b-37188473341d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:09.017340 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57bd13-805a-4d23-aec2-2cdd7f804906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:09.018570 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57bd13-805a-4d23-aec2-2cdd7f804906 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:09.019034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57bd13-805a-4d23-aec2-2cdd7f804906 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:09.019485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57bd13-805a-4d23-aec2-2cdd7f804906 admin admin] PATH_INFO: `/v3/projects/180f3443a6cc4812925d74f53babf199/users/a7f186a204be4043b7179f90a6957e51/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:09.023856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57bd13-805a-4d23-aec2-2cdd7f804906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180f3443a6cc4812925d74f53babf199, user_id=a7f186a204be4043b7179f90a6957e51, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:09.030706 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57bd13-805a-4d23-aec2-2cdd7f804906 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:09.065988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1111/2222] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:51:08 2022] PUT /identity/v3/projects/180f3443a6cc4812925d74f53babf199/users/a7f186a204be4043b7179f90a6957e51/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:51:21.461977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a64ef8-1477-4778-9f87-72af58b9c1d3 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:21.463608 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a64ef8-1477-4778-9f87-72af58b9c1d3 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:21.464492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a64ef8-1477-4778-9f87-72af58b9c1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:21.522088 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-19a64ef8-1477-4778-9f87-72af58b9c1d3 None None] MFA Rules not processed for user `a7f186a204be4043b7179f90a6957e51`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:51:21.523467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-19a64ef8-1477-4778-9f87-72af58b9c1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:21.679139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1112/2223] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:51:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:51:21.964242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57bd13-805a-4d23-aec2-2cdd7f804906 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:21.966966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3f57bd13-805a-4d23-aec2-2cdd7f804906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:22.260707 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57bd13-805a-4d23-aec2-2cdd7f804906 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:22.271410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a73ff1-5735-485c-b5cf-59db4062858e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:22.273126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a73ff1-5735-485c-b5cf-59db4062858e service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:22.273959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a73ff1-5735-485c-b5cf-59db4062858e service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:22.274734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a73ff1-5735-485c-b5cf-59db4062858e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:22.401289 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a73ff1-5735-485c-b5cf-59db4062858e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:22.404285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a73ff1-5735-485c-b5cf-59db4062858e service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:22.433156 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1112/2224] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:51:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:51:29.224740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee44f-485d-4275-aaf1-0a28844769f8 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:29.225360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee44f-485d-4275-aaf1-0a28844769f8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:29.225360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee44f-485d-4275-aaf1-0a28844769f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:29.316436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1afee44f-485d-4275-aaf1-0a28844769f8 None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:51:29.318116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1afee44f-485d-4275-aaf1-0a28844769f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:29.453306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1113/2225] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:51:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:51:29.594530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a73ff1-5735-485c-b5cf-59db4062858e service nova] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:29.597227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-95a73ff1-5735-485c-b5cf-59db4062858e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:29.810473 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a73ff1-5735-485c-b5cf-59db4062858e service nova] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:29.822108 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6fa54-19ca-4cd0-a7fd-0e735e1df556 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:29.823634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6fa54-19ca-4cd0-a7fd-0e735e1df556 service swift] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:29.824385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6fa54-19ca-4cd0-a7fd-0e735e1df556 service swift] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:29.825059 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6fa54-19ca-4cd0-a7fd-0e735e1df556 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:29.842763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6fa54-19ca-4cd0-a7fd-0e735e1df556 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:29.844956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6fa54-19ca-4cd0-a7fd-0e735e1df556 service swift] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:29.858335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1113/2226] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:51:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 18:51:39.922286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afee44f-485d-4275-aaf1-0a28844769f8 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:39.924567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1afee44f-485d-4275-aaf1-0a28844769f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:40.137868 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afee44f-485d-4275-aaf1-0a28844769f8 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:40.147299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f92f8-79cc-4908-837f-f6c47f3aebd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443fd569cd1b4f6db86d575ed669e26a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:40.147899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f92f8-79cc-4908-837f-f6c47f3aebd6 service placement] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:40.148384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f92f8-79cc-4908-837f-f6c47f3aebd6 service placement] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:40.148681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f92f8-79cc-4908-837f-f6c47f3aebd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:40.150628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c49f92f8-79cc-4908-837f-f6c47f3aebd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:40.170351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f92f8-79cc-4908-837f-f6c47f3aebd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:40.173899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f92f8-79cc-4908-837f-f6c47f3aebd6 service placement] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:40.189161 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1114/2227] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:51:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:51:40.522329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6fa54-19ca-4cd0-a7fd-0e735e1df556 service swift] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:40.525094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-cfb6fa54-19ca-4cd0-a7fd-0e735e1df556 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:40.690690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6fa54-19ca-4cd0-a7fd-0e735e1df556 service swift] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:40.704961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfb3ba-011c-416d-8a6e-0c7285cc13cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:40.706778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb3ba-011c-416d-8a6e-0c7285cc13cc service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:40.707257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb3ba-011c-416d-8a6e-0c7285cc13cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:40.710310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb3ba-011c-416d-8a6e-0c7285cc13cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:40.717199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-64cfb3ba-011c-416d-8a6e-0c7285cc13cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:40.901672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfb3ba-011c-416d-8a6e-0c7285cc13cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:40.904624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfb3ba-011c-416d-8a6e-0c7285cc13cc service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:40.917240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1114/2228] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:51:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:51:48.071853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b99281-839f-428b-b6b7-9405572c15ac None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:48.073697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b99281-839f-428b-b6b7-9405572c15ac None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:48.074396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b99281-839f-428b-b6b7-9405572c15ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:48.105419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-64b99281-839f-428b-b6b7-9405572c15ac None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:51:48.108038 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-64b99281-839f-428b-b6b7-9405572c15ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:48.118533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1115/2229] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:51:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:51:48.135345 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfb3ba-011c-416d-8a6e-0c7285cc13cc service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:48.156444 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfb3ba-011c-416d-8a6e-0c7285cc13cc service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:48.164351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd00f2-5a93-414a-b928-5999479f7c5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:48.165300 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd00f2-5a93-414a-b928-5999479f7c5e service swift] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:48.165636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd00f2-5a93-414a-b928-5999479f7c5e service swift] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:48.166299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd00f2-5a93-414a-b928-5999479f7c5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:48.180546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd00f2-5a93-414a-b928-5999479f7c5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:48.182654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd00f2-5a93-414a-b928-5999479f7c5e service swift] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:48.195059 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1115/2230] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:51:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:51:53.340585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c82b81-ad65-4cb6-811c-6f901bafe235 None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:53.341311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c82b81-ad65-4cb6-811c-6f901bafe235 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:53.341311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c82b81-ad65-4cb6-811c-6f901bafe235 None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:53.343869 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1116/2231] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:51:53.352173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89d025-cce0-4835-9c4a-e00fde0736fa None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:53.352944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89d025-cce0-4835-9c4a-e00fde0736fa None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:53.352944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89d025-cce0-4835-9c4a-e00fde0736fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:53.484658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-fb89d025-cce0-4835-9c4a-e00fde0736fa None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:51:53.488185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-fb89d025-cce0-4835-9c4a-e00fde0736fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:53.508176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1116/2232] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:51:53.527008 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c82b81-ad65-4cb6-811c-6f901bafe235 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:53.531208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-60c82b81-ad65-4cb6-811c-6f901bafe235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:53.695526 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c82b81-ad65-4cb6-811c-6f901bafe235 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:53.708297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928e2ae-8e73-44f9-ad20-03451c0c4e29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0e623c10804239a076fc6cde9b198d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:53.709724 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e2ae-8e73-44f9-ad20-03451c0c4e29 service glance] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:53.710184 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e2ae-8e73-44f9-ad20-03451c0c4e29 service glance] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:53.710641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928e2ae-8e73-44f9-ad20-03451c0c4e29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:53.730412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928e2ae-8e73-44f9-ad20-03451c0c4e29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:53.732133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928e2ae-8e73-44f9-ad20-03451c0c4e29 service glance] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:53.766759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde91708-f141-4fa5-acad-864c0f776a9a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:53.767267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde91708-f141-4fa5-acad-864c0f776a9a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:53.767817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde91708-f141-4fa5-acad-864c0f776a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:53.768760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1117/2233] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:51:53.803052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-fde91708-f141-4fa5-acad-864c0f776a9a None None] MFA Rules not processed for user `5e9ebfaac4984817bb768476ef74445c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:51:53.805856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-fde91708-f141-4fa5-acad-864c0f776a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:53.819142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1117/2234] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:51:53.899142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0cf26-58e0-4f7b-bf15-2e70877fc46c None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:53.900405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0cf26-58e0-4f7b-bf15-2e70877fc46c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:53.901257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0cf26-58e0-4f7b-bf15-2e70877fc46c None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:53.904064 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1118/2235] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:51:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:51:53.910192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c2b0a-41ee-4e02-a8c2-7ee90d43d09b None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:53.910826 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c2b0a-41ee-4e02-a8c2-7ee90d43d09b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:53.911421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c2b0a-41ee-4e02-a8c2-7ee90d43d09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:53.970135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-911c2b0a-41ee-4e02-a8c2-7ee90d43d09b None None] MFA Rules not processed for user `c22a0fc8a3914f7fb3356a84827db326`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:51:53.973386 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-911c2b0a-41ee-4e02-a8c2-7ee90d43d09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:53.996888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0cf26-58e0-4f7b-bf15-2e70877fc46c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:54.006921 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1118/2236] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:51:54.018830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0cf26-58e0-4f7b-bf15-2e70877fc46c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:54.027859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b64fcf-eb0c-4281-9cb3-e9735bc15378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:54.030658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64fcf-eb0c-4281-9cb3-e9735bc15378 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:54.031339 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64fcf-eb0c-4281-9cb3-e9735bc15378 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:54.032099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b64fcf-eb0c-4281-9cb3-e9735bc15378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:54.053736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b64fcf-eb0c-4281-9cb3-e9735bc15378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:54.057505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b64fcf-eb0c-4281-9cb3-e9735bc15378 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:54.074383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1119/2237] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:51:54.331989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a2e03-d78a-4695-a3bc-87ccbe24fce5 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:54.333267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a2e03-d78a-4695-a3bc-87ccbe24fce5 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:54.334398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a2e03-d78a-4695-a3bc-87ccbe24fce5 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:54.339084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1119/2238] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:51:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 18:51:54.363250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c61956-d999-42a0-ac27-aaf1ea959b71 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:54.363882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c61956-d999-42a0-ac27-aaf1ea959b71 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:54.364386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c61956-d999-42a0-ac27-aaf1ea959b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:54.403867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-79c61956-d999-42a0-ac27-aaf1ea959b71 None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:51:54.406016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-79c61956-d999-42a0-ac27-aaf1ea959b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:51:54.422607 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1120/2239] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:51:54.450000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a2e03-d78a-4695-a3bc-87ccbe24fce5 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:51:54.484489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a2e03-d78a-4695-a3bc-87ccbe24fce5 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:51:54.500058 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460a28-e931-4f5a-9c94-4ad6fc8b2f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:51:54.503992 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460a28-e931-4f5a-9c94-4ad6fc8b2f79 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:51:54.504968 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460a28-e931-4f5a-9c94-4ad6fc8b2f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:51:54.506948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460a28-e931-4f5a-9c94-4ad6fc8b2f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:51:54.528736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2460a28-e931-4f5a-9c94-4ad6fc8b2f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:51:54.532867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2460a28-e931-4f5a-9c94-4ad6fc8b2f79 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:51:54.569792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1120/2240] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:51:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:52:04.571845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259f70-e5c8-4bd7-9fac-65305db59e8c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:04.571845 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259f70-e5c8-4bd7-9fac-65305db59e8c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:04.573541 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259f70-e5c8-4bd7-9fac-65305db59e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:04.622755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-5f259f70-e5c8-4bd7-9fac-65305db59e8c None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:04.625120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5f259f70-e5c8-4bd7-9fac-65305db59e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:04.638706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1121/2241] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:52:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:52:04.739846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460a28-e931-4f5a-9c94-4ad6fc8b2f79 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:04.769432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460a28-e931-4f5a-9c94-4ad6fc8b2f79 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:04.791809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33deae-4465-41f8-bae6-6c29745058d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:04.792517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33deae-4465-41f8-bae6-6c29745058d4 service swift] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:04.793022 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33deae-4465-41f8-bae6-6c29745058d4 service swift] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:04.793475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33deae-4465-41f8-bae6-6c29745058d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:04.808247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33deae-4465-41f8-bae6-6c29745058d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:04.824281 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33deae-4465-41f8-bae6-6c29745058d4 service swift] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:04.869046 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1121/2242] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:52:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 18:52:13.292907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e69651-e94b-4edb-9887-68ff3899c8e4 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:13.293557 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e69651-e94b-4edb-9887-68ff3899c8e4 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:13.293814 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e69651-e94b-4edb-9887-68ff3899c8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:13.324844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-95e69651-e94b-4edb-9887-68ff3899c8e4 None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:13.327072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-95e69651-e94b-4edb-9887-68ff3899c8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:13.339297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1122/2243] 10.222.0.72 () {58 vars in 967 bytes} [Mon May 16 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:52:13.360302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33deae-4465-41f8-bae6-6c29745058d4 service swift] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:13.383223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33deae-4465-41f8-bae6-6c29745058d4 service swift] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:13.393844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec8cb-b36a-473b-9709-5af04d5e9a8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:13.395066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec8cb-b36a-473b-9709-5af04d5e9a8e service swift] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:13.395562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec8cb-b36a-473b-9709-5af04d5e9a8e service swift] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:13.396049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec8cb-b36a-473b-9709-5af04d5e9a8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:13.412255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ec8cb-b36a-473b-9709-5af04d5e9a8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:13.415412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ec8cb-b36a-473b-9709-5af04d5e9a8e service swift] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:13.429812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1122/2244] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:52:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 18:52:16.372069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e69651-e94b-4edb-9887-68ff3899c8e4 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:16.375131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-95e69651-e94b-4edb-9887-68ff3899c8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:16.505873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e69651-e94b-4edb-9887-68ff3899c8e4 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:16.510995 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7195be-55be-4072-b35b-4246fa810011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:16.512158 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7195be-55be-4072-b35b-4246fa810011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:16.512538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7195be-55be-4072-b35b-4246fa810011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:16.512943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7195be-55be-4072-b35b-4246fa810011 admin admin] PATH_INFO: `/v3/users/4d2178471fe6400ea4db132f72bc334e` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:16.515222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7195be-55be-4072-b35b-4246fa810011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2178471fe6400ea4db132f72bc334e)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:16.518378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7195be-55be-4072-b35b-4246fa810011 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:16.597614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7c7195be-55be-4072-b35b-4246fa810011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2178471fe6400ea4db132f72bc334e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:16.638715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7c7195be-55be-4072-b35b-4246fa810011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2178471fe6400ea4db132f72bc334e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:16.639787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7c7195be-55be-4072-b35b-4246fa810011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2178471fe6400ea4db132f72bc334e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:16.640701 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7c7195be-55be-4072-b35b-4246fa810011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2178471fe6400ea4db132f72bc334e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:16.654955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7c7195be-55be-4072-b35b-4246fa810011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2178471fe6400ea4db132f72bc334e'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:16.693117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1123/2245] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:52:16 2022] DELETE /identity/v3/users/4d2178471fe6400ea4db132f72bc334e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:52:17.033347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec8cb-b36a-473b-9709-5af04d5e9a8e service swift] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:17.058329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec8cb-b36a-473b-9709-5af04d5e9a8e service swift] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:17.166158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:17.167179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:17.167464 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:17.167776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] PATH_INFO: `/v3/projects/b7c0f4a8f9e04a71a6b71e704c29437a` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:17.169282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c0f4a8f9e04a71a6b71e704c29437a)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:17.172814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:17.241416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'request_id': 'req-546c0c4f-bfd1-4472-a66f-26cf97ca858d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:17.250042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'request_id': 'req-546c0c4f-bfd1-4472-a66f-26cf97ca858d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:17.262816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c0f4a8f9e04a71a6b71e704c29437a', 'request_id': 'req-546c0c4f-bfd1-4472-a66f-26cf97ca858d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:17.284151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] The token cache is being invalidate because project b7c0f4a8f9e04a71a6b71e704c29437a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:52:17.284974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:17.285999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-546c0c4f-bfd1-4472-a66f-26cf97ca858d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:17.288704 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1123/2246] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:52:17 2022] DELETE /identity/v3/projects/b7c0f4a8f9e04a71a6b71e704c29437a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:52:17.296045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b003ff4-4463-4b01-8693-a3f10512b0f2 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:17.296346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b003ff4-4463-4b01-8693-a3f10512b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:17.296624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b003ff4-4463-4b01-8693-a3f10512b0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:17.327456 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0b003ff4-4463-4b01-8693-a3f10512b0f2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:17.329522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0b003ff4-4463-4b01-8693-a3f10512b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:17.433743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1124/2247] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:52:17.443160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3693762-ea65-48a1-a744-27c1098ea1f7 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:17.443772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3693762-ea65-48a1-a744-27c1098ea1f7 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:17.444343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3693762-ea65-48a1-a744-27c1098ea1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:17.476592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c3693762-ea65-48a1-a744-27c1098ea1f7 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:17.478666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c3693762-ea65-48a1-a744-27c1098ea1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:17.490842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1124/2248] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:52:17.495365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b003ff4-4463-4b01-8693-a3f10512b0f2 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:17.506050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b003ff4-4463-4b01-8693-a3f10512b0f2 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:17.511752 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07758479-21f6-4aae-af00-b9be6ff008c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:17.513112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07758479-21f6-4aae-af00-b9be6ff008c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:17.514126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07758479-21f6-4aae-af00-b9be6ff008c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:17.514616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07758479-21f6-4aae-af00-b9be6ff008c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:17.515736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07758479-21f6-4aae-af00-b9be6ff008c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:52:17.516149 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07758479-21f6-4aae-af00-b9be6ff008c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:17.518073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07758479-21f6-4aae-af00-b9be6ff008c2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:17.532367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1125/2249] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:52:17.537476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3693762-ea65-48a1-a744-27c1098ea1f7 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:17.551130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3693762-ea65-48a1-a744-27c1098ea1f7 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:17.557257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027dc39-39a0-491e-b896-2251e74b2860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:17.558014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027dc39-39a0-491e-b896-2251e74b2860 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:17.558290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027dc39-39a0-491e-b896-2251e74b2860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:17.558556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027dc39-39a0-491e-b896-2251e74b2860 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:17.559258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027dc39-39a0-491e-b896-2251e74b2860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:17.561798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027dc39-39a0-491e-b896-2251e74b2860 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:17.602406 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1125/2250] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:52:17 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:52:17.604292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07758479-21f6-4aae-af00-b9be6ff008c2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:17.623387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07758479-21f6-4aae-af00-b9be6ff008c2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:17.733443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80a4a3-e291-470a-a27e-bac378e23f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:17.734218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80a4a3-e291-470a-a27e-bac378e23f97 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:17.734593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80a4a3-e291-470a-a27e-bac378e23f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:17.735028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80a4a3-e291-470a-a27e-bac378e23f97 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:17.736828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80a4a3-e291-470a-a27e-bac378e23f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:17.740859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80a4a3-e291-470a-a27e-bac378e23f97 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:17.781451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1126/2251] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:52:17 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:52:17.781755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027dc39-39a0-491e-b896-2251e74b2860 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:17.817971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027dc39-39a0-491e-b896-2251e74b2860 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:17.833108 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f207a-3ec9-42ef-bef9-13a85e3fe918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:17.834588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f207a-3ec9-42ef-bef9-13a85e3fe918 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:17.835325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f207a-3ec9-42ef-bef9-13a85e3fe918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:17.835742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f207a-3ec9-42ef-bef9-13a85e3fe918 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:17.837118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f207a-3ec9-42ef-bef9-13a85e3fe918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:17.840451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f207a-3ec9-42ef-bef9-13a85e3fe918 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:17.863529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1126/2252] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:52:17.867515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80a4a3-e291-470a-a27e-bac378e23f97 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:17.892473 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80a4a3-e291-470a-a27e-bac378e23f97 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:17.906384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2eaaa0-2e3b-4570-9911-531bc1a0fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:17.907953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eaaa0-2e3b-4570-9911-531bc1a0fe7b admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:17.908832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eaaa0-2e3b-4570-9911-531bc1a0fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:17.909280 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eaaa0-2e3b-4570-9911-531bc1a0fe7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:17.910602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2eaaa0-2e3b-4570-9911-531bc1a0fe7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:17.913533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2eaaa0-2e3b-4570-9911-531bc1a0fe7b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:17.948884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1127/2253] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:52:17.949146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f207a-3ec9-42ef-bef9-13a85e3fe918 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:17.964445 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f207a-3ec9-42ef-bef9-13a85e3fe918 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:17.979066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c795d23-54de-457d-aac0-b844e530ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:17.980718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c795d23-54de-457d-aac0-b844e530ba4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:17.981223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c795d23-54de-457d-aac0-b844e530ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:17.981716 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c795d23-54de-457d-aac0-b844e530ba4a admin admin] PATH_INFO: `/v3/projects/c9dbabdde9344c3b81369f69c4e0d525/users/317d4dc67a044b4296c5fe325e261d09/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:18.013530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c795d23-54de-457d-aac0-b844e530ba4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9dbabdde9344c3b81369f69c4e0d525, user_id=317d4dc67a044b4296c5fe325e261d09, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:18.023362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c795d23-54de-457d-aac0-b844e530ba4a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:18.048775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1127/2254] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:52:17 2022] PUT /identity/v3/projects/c9dbabdde9344c3b81369f69c4e0d525/users/317d4dc67a044b4296c5fe325e261d09/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:52:18.070281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da92b-3718-48a0-9a0f-75db929ec688 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:18.070716 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da92b-3718-48a0-9a0f-75db929ec688 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:18.071298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da92b-3718-48a0-9a0f-75db929ec688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:18.142555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4f2da92b-3718-48a0-9a0f-75db929ec688 None None] MFA Rules not processed for user `317d4dc67a044b4296c5fe325e261d09`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:18.144793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4f2da92b-3718-48a0-9a0f-75db929ec688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:18.298754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1128/2255] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:52:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:52:18.315947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c795d23-54de-457d-aac0-b844e530ba4a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:18.318502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0c795d23-54de-457d-aac0-b844e530ba4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:18.444302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c795d23-54de-457d-aac0-b844e530ba4a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:18.451234 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4925fa-7532-4666-b44a-5f05f12cd886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:18.452746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4925fa-7532-4666-b44a-5f05f12cd886 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:18.453486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4925fa-7532-4666-b44a-5f05f12cd886 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:18.454220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4925fa-7532-4666-b44a-5f05f12cd886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:18.473617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4925fa-7532-4666-b44a-5f05f12cd886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:18.476473 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4925fa-7532-4666-b44a-5f05f12cd886 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:18.497727 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1128/2256] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:52:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:52:18.527525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2da92b-3718-48a0-9a0f-75db929ec688 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:18.617358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2da92b-3718-48a0-9a0f-75db929ec688 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:18.622977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:18.624293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:18.624575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:18.624858 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] PATH_INFO: `/v3/users/317d4dc67a044b4296c5fe325e261d09` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:18.626223 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=317d4dc67a044b4296c5fe325e261d09)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:18.628351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:18.696505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '317d4dc67a044b4296c5fe325e261d09'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:18.712852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '317d4dc67a044b4296c5fe325e261d09'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:18.713847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '317d4dc67a044b4296c5fe325e261d09'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:18.714598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '317d4dc67a044b4296c5fe325e261d09'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:18.725411 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '317d4dc67a044b4296c5fe325e261d09'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:18.751691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1129/2257] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:52:18 2022] DELETE /identity/v3/users/317d4dc67a044b4296c5fe325e261d09 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:52:18.760394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7936e5-73b6-45bb-bf2c-5414f6874622 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:18.760871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7936e5-73b6-45bb-bf2c-5414f6874622 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:18.761331 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7936e5-73b6-45bb-bf2c-5414f6874622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:18.785693 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-7a7936e5-73b6-45bb-bf2c-5414f6874622 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:18.786906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7a7936e5-73b6-45bb-bf2c-5414f6874622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:18.893267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1129/2258] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:52:18.908993 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:18.910940 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:19.009886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae787b-3d56-4957-aef8-e91e26060383 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:19.015322 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b115739-0221-4949-afb1-f7ae9176bc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:19.016041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b115739-0221-4949-afb1-f7ae9176bc4b service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:19.016334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b115739-0221-4949-afb1-f7ae9176bc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:19.016673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b115739-0221-4949-afb1-f7ae9176bc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:19.029966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b115739-0221-4949-afb1-f7ae9176bc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:19.032850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b115739-0221-4949-afb1-f7ae9176bc4b service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:19.046113 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1130/2259] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:52:19.648301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7936e5-73b6-45bb-bf2c-5414f6874622 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:19.649885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7a7936e5-73b6-45bb-bf2c-5414f6874622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:19.673756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7936e5-73b6-45bb-bf2c-5414f6874622 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:19.680330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:19.681245 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:19.681511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:19.681788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] PATH_INFO: `/v3/projects/c9dbabdde9344c3b81369f69c4e0d525` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:19.683352 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9dbabdde9344c3b81369f69c4e0d525)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:19.685463 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:19.772824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9dbabdde9344c3b81369f69c4e0d525', 'request_id': 'req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:19.782451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9dbabdde9344c3b81369f69c4e0d525', 'request_id': 'req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:19.807129 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9dbabdde9344c3b81369f69c4e0d525', 'request_id': 'req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:19.835609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] The token cache is being invalidate because project c9dbabdde9344c3b81369f69c4e0d525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:52:19.836336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:19.837523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1bc82448-9b3a-4dc8-a13b-4c8b91d9b774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:19.839948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1130/2260] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:52:19 2022] DELETE /identity/v3/projects/c9dbabdde9344c3b81369f69c4e0d525 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:52:19.847674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1f14-09c1-4a85-8c13-faf8a09ab711 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:19.848610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1f14-09c1-4a85-8c13-faf8a09ab711 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:19.848610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1f14-09c1-4a85-8c13-faf8a09ab711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:19.892245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-44bd1f14-09c1-4a85-8c13-faf8a09ab711 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:19.893644 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-44bd1f14-09c1-4a85-8c13-faf8a09ab711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:20.032974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1131/2261] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:52:20.042636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f141-7cb2-4c19-86d8-114554e66988 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:20.042942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f141-7cb2-4c19-86d8-114554e66988 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:20.043284 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f141-7cb2-4c19-86d8-114554e66988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:20.091096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c7a1f141-7cb2-4c19-86d8-114554e66988 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:20.095337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c7a1f141-7cb2-4c19-86d8-114554e66988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:20.114024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1131/2262] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:52:20.122420 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd1f14-09c1-4a85-8c13-faf8a09ab711 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:20.140064 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd1f14-09c1-4a85-8c13-faf8a09ab711 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:20.145314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f6977-2a01-4251-a9f1-f4e23af40248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:20.146220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f6977-2a01-4251-a9f1-f4e23af40248 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:20.146510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f6977-2a01-4251-a9f1-f4e23af40248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:20.146782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f6977-2a01-4251-a9f1-f4e23af40248 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:20.147531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f6977-2a01-4251-a9f1-f4e23af40248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:52:20.148047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f6977-2a01-4251-a9f1-f4e23af40248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:20.149710 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f6977-2a01-4251-a9f1-f4e23af40248 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:20.169248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1132/2263] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:52:20.176078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1f141-7cb2-4c19-86d8-114554e66988 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:20.186232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1f141-7cb2-4c19-86d8-114554e66988 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:20.191610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7131c-3258-4c08-8193-43387729a4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:20.192362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7131c-3258-4c08-8193-43387729a4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:20.192688 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7131c-3258-4c08-8193-43387729a4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:20.192999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7131c-3258-4c08-8193-43387729a4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:20.193745 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7131c-3258-4c08-8193-43387729a4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:20.195864 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7131c-3258-4c08-8193-43387729a4e1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:20.234786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1132/2264] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:52:20 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:52:20.243021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f6977-2a01-4251-a9f1-f4e23af40248 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:20.259680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f6977-2a01-4251-a9f1-f4e23af40248 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:20.353102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4220ffb-497c-4407-894a-e080330a89ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:20.354059 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220ffb-497c-4407-894a-e080330a89ee admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:20.354684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220ffb-497c-4407-894a-e080330a89ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:20.355331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220ffb-497c-4407-894a-e080330a89ee admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:20.356978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4220ffb-497c-4407-894a-e080330a89ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:20.364306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4220ffb-497c-4407-894a-e080330a89ee admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:20.394282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1133/2265] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:52:20 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:52:20.399091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7131c-3258-4c08-8193-43387729a4e1 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:20.411821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7131c-3258-4c08-8193-43387729a4e1 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:20.417029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d28505-fe38-40a1-9012-4280f18e2d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:20.417752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d28505-fe38-40a1-9012-4280f18e2d2f admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:20.418035 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d28505-fe38-40a1-9012-4280f18e2d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:20.418315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d28505-fe38-40a1-9012-4280f18e2d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:20.419206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d28505-fe38-40a1-9012-4280f18e2d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:20.421142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d28505-fe38-40a1-9012-4280f18e2d2f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:20.433914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1133/2266] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:52:20.439021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4220ffb-497c-4407-894a-e080330a89ee admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:20.459115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4220ffb-497c-4407-894a-e080330a89ee admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:20.474548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28254bd1-80ba-49d6-9ea0-823c2c84803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:20.475670 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28254bd1-80ba-49d6-9ea0-823c2c84803f admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:20.476221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28254bd1-80ba-49d6-9ea0-823c2c84803f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:20.476725 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28254bd1-80ba-49d6-9ea0-823c2c84803f admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:20.477974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28254bd1-80ba-49d6-9ea0-823c2c84803f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:20.480641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28254bd1-80ba-49d6-9ea0-823c2c84803f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:20.500823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1134/2267] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:52:20.505726 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d28505-fe38-40a1-9012-4280f18e2d2f admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:20.521308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d28505-fe38-40a1-9012-4280f18e2d2f admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:20.529936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b95ff-ed4c-4987-b052-d794cba31ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:20.531578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b95ff-ed4c-4987-b052-d794cba31ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:20.532227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b95ff-ed4c-4987-b052-d794cba31ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:20.532564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b95ff-ed4c-4987-b052-d794cba31ab4 admin admin] PATH_INFO: `/v3/projects/b099561e43854b25ba1581a7536e939f/users/60e2427375054f9f8ae4f7b76ecc8927/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:20.553347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b95ff-ed4c-4987-b052-d794cba31ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b099561e43854b25ba1581a7536e939f, user_id=60e2427375054f9f8ae4f7b76ecc8927, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:20.557695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b95ff-ed4c-4987-b052-d794cba31ab4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:20.578035 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1134/2268] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:52:20 2022] PUT /identity/v3/projects/b099561e43854b25ba1581a7536e939f/users/60e2427375054f9f8ae4f7b76ecc8927/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:52:20.594352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a921e-af25-40ad-851c-6c98b7d3c448 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:20.594352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a921e-af25-40ad-851c-6c98b7d3c448 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:20.594352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a921e-af25-40ad-851c-6c98b7d3c448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:20.630245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-bd6a921e-af25-40ad-851c-6c98b7d3c448 None None] MFA Rules not processed for user `60e2427375054f9f8ae4f7b76ecc8927`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:20.631932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-bd6a921e-af25-40ad-851c-6c98b7d3c448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:20.752005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1135/2269] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:52:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:52:20.765276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b95ff-ed4c-4987-b052-d794cba31ab4 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:20.767665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-212b95ff-ed4c-4987-b052-d794cba31ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:20.878297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b95ff-ed4c-4987-b052-d794cba31ab4 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:20.883683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833adae-13a3-4978-8ccf-422f0607071d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:20.884737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833adae-13a3-4978-8ccf-422f0607071d service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:20.885202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833adae-13a3-4978-8ccf-422f0607071d service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:20.885608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833adae-13a3-4978-8ccf-422f0607071d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:20.900344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833adae-13a3-4978-8ccf-422f0607071d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:20.903137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833adae-13a3-4978-8ccf-422f0607071d service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:20.920260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1135/2270] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:52:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:52:30.790237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd631d9-4b83-4b56-87fb-940acdaeab53 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:30.791123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd631d9-4b83-4b56-87fb-940acdaeab53 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:30.791123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd631d9-4b83-4b56-87fb-940acdaeab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:30.812994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-cfd631d9-4b83-4b56-87fb-940acdaeab53 None None] MFA Rules not processed for user `89539508b327427ba1a449fe30569606`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:30.814962 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-cfd631d9-4b83-4b56-87fb-940acdaeab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:30.901489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1136/2271] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:52:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:52:32.516457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833adae-13a3-4978-8ccf-422f0607071d service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:32.607832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833adae-13a3-4978-8ccf-422f0607071d service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:32.616027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:32.617058 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:32.617402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:32.617743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] PATH_INFO: `/v3/users/60e2427375054f9f8ae4f7b76ecc8927` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:32.619223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e2427375054f9f8ae4f7b76ecc8927)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:32.621147 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:32.702062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e2427375054f9f8ae4f7b76ecc8927'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:32.726772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e2427375054f9f8ae4f7b76ecc8927'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:32.728078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e2427375054f9f8ae4f7b76ecc8927'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:32.740128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e2427375054f9f8ae4f7b76ecc8927'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:32.752563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e2427375054f9f8ae4f7b76ecc8927'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:32.763820 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1136/2272] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:52:32 2022] DELETE /identity/v3/users/60e2427375054f9f8ae4f7b76ecc8927 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:52:32.771590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417366-ce6d-4f56-b7dd-6ce06f8bb6f2 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:32.772382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417366-ce6d-4f56-b7dd-6ce06f8bb6f2 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:32.772644 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417366-ce6d-4f56-b7dd-6ce06f8bb6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:32.795101 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-cf417366-ce6d-4f56-b7dd-6ce06f8bb6f2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:32.796465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-cf417366-ce6d-4f56-b7dd-6ce06f8bb6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:32.919830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1137/2273] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:52:32.934157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:32.937502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:33.040857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09b612-784f-4a07-b17d-85be6f1b43b5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:33.048518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7069957-0fbb-46ca-833c-c5867285acfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:33.049603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069957-0fbb-46ca-833c-c5867285acfd service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:33.050122 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069957-0fbb-46ca-833c-c5867285acfd service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:33.050933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7069957-0fbb-46ca-833c-c5867285acfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:33.065807 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7069957-0fbb-46ca-833c-c5867285acfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:33.067737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7069957-0fbb-46ca-833c-c5867285acfd service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:33.081827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1137/2274] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:52:33.489751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf417366-ce6d-4f56-b7dd-6ce06f8bb6f2 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:33.494132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-cf417366-ce6d-4f56-b7dd-6ce06f8bb6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:33.517658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf417366-ce6d-4f56-b7dd-6ce06f8bb6f2 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:33.522628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:33.524013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:33.524948 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:33.525377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] PATH_INFO: `/v3/projects/b099561e43854b25ba1581a7536e939f` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:33.526942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b099561e43854b25ba1581a7536e939f)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:33.530068 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:33.625563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b099561e43854b25ba1581a7536e939f', 'request_id': 'req-c3bd003b-dc8e-4c14-a785-3111f23dbc04'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:33.640838 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b099561e43854b25ba1581a7536e939f', 'request_id': 'req-c3bd003b-dc8e-4c14-a785-3111f23dbc04'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:33.651417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b099561e43854b25ba1581a7536e939f', 'request_id': 'req-c3bd003b-dc8e-4c14-a785-3111f23dbc04'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:33.670680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] The token cache is being invalidate because project b099561e43854b25ba1581a7536e939f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:52:33.671172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:33.672057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:52:33.674572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1138/2275] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:52:33 2022] DELETE /identity/v3/projects/b099561e43854b25ba1581a7536e939f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:52:37.940238 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725544-7118-43a4-8658-25459d2a1e87 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:37.940957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725544-7118-43a4-8658-25459d2a1e87 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:37.940957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725544-7118-43a4-8658-25459d2a1e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:37.974244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-23725544-7118-43a4-8658-25459d2a1e87 None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:52:37.976272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-23725544-7118-43a4-8658-25459d2a1e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:38.058844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1138/2276] 10.222.0.72 () {58 vars in 967 bytes} [Mon May 16 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:52:38.095422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:38.097572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:38.205381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd003b-dc8e-4c14-a785-3111f23dbc04 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:38.217782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc302f-d8dd-4707-850b-43ff80cf9505 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:38.219159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc302f-d8dd-4707-850b-43ff80cf9505 service swift] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:38.219636 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc302f-d8dd-4707-850b-43ff80cf9505 service swift] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:38.220165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc302f-d8dd-4707-850b-43ff80cf9505 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:38.232518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc302f-d8dd-4707-850b-43ff80cf9505 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:38.234246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc302f-d8dd-4707-850b-43ff80cf9505 service swift] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:38.245127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1139/2277] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:52:41.511534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23725544-7118-43a4-8658-25459d2a1e87 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:52:41.514167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-23725544-7118-43a4-8658-25459d2a1e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:41.603103 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23725544-7118-43a4-8658-25459d2a1e87 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:52:41.609863 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ab1b6-3163-4968-a119-b7f65cd84c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:52:41.610999 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ab1b6-3163-4968-a119-b7f65cd84c3b service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:52:41.611490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ab1b6-3163-4968-a119-b7f65cd84c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:52:41.611972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ab1b6-3163-4968-a119-b7f65cd84c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:52:41.614498 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9c6ab1b6-3163-4968-a119-b7f65cd84c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:52:41.722150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ab1b6-3163-4968-a119-b7f65cd84c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:52:41.724868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ab1b6-3163-4968-a119-b7f65cd84c3b service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:52:41.743221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1139/2278] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:52:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:53:17.007300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed4cb-c4c6-4bd5-8abe-f0084ce94643 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:17.008452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed4cb-c4c6-4bd5-8abe-f0084ce94643 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:17.008452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed4cb-c4c6-4bd5-8abe-f0084ce94643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:17.031408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-ff7ed4cb-c4c6-4bd5-8abe-f0084ce94643 None None] MFA Rules not processed for user `cd0d8acbe24d410690470e3d9d4882b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:17.032691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ff7ed4cb-c4c6-4bd5-8abe-f0084ce94643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:17.101448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1140/2279] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:53:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:53:39.255652 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ab1b6-3163-4968-a119-b7f65cd84c3b service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:39.257843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9c6ab1b6-3163-4968-a119-b7f65cd84c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:39.349295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ab1b6-3163-4968-a119-b7f65cd84c3b service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:39.353979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6cdbf-4723-4c40-9b91-e4af0df677e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:39.355055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6cdbf-4723-4c40-9b91-e4af0df677e2 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:39.355410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6cdbf-4723-4c40-9b91-e4af0df677e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:39.355761 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6cdbf-4723-4c40-9b91-e4af0df677e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:39.358166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-23d6cdbf-4723-4c40-9b91-e4af0df677e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:39.442310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6cdbf-4723-4c40-9b91-e4af0df677e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:39.444391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6cdbf-4723-4c40-9b91-e4af0df677e2 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:39.463227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1140/2280] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:53:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:53:42.283138 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ed4cb-c4c6-4bd5-8abe-f0084ce94643 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:42.296685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ed4cb-c4c6-4bd5-8abe-f0084ce94643 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:42.300792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594f08b-018f-4ed6-ae7f-651153074895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:42.301476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594f08b-018f-4ed6-ae7f-651153074895 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:42.301763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594f08b-018f-4ed6-ae7f-651153074895 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:42.302049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594f08b-018f-4ed6-ae7f-651153074895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:42.304120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a594f08b-018f-4ed6-ae7f-651153074895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:42.326400 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594f08b-018f-4ed6-ae7f-651153074895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:42.327956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594f08b-018f-4ed6-ae7f-651153074895 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:42.341292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1141/2281] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:53:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:53:46.812863 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6cdbf-4723-4c40-9b91-e4af0df677e2 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:46.820421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-23d6cdbf-4723-4c40-9b91-e4af0df677e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:46.830326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6cdbf-4723-4c40-9b91-e4af0df677e2 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:46.837173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a2a4-9b38-4551-be79-bdf6cfe2aa32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:46.837898 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a2a4-9b38-4551-be79-bdf6cfe2aa32 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:46.838288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a2a4-9b38-4551-be79-bdf6cfe2aa32 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:46.839251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a2a4-9b38-4551-be79-bdf6cfe2aa32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:46.841690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1fd5a2a4-9b38-4551-be79-bdf6cfe2aa32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:46.922227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5a2a4-9b38-4551-be79-bdf6cfe2aa32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:46.925078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5a2a4-9b38-4551-be79-bdf6cfe2aa32 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:46.937605 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1141/2282] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:53:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:53:48.318005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5604f4f-d18d-4ec5-bcd7-485b275123d5 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:48.318887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5604f4f-d18d-4ec5-bcd7-485b275123d5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:48.318887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5604f4f-d18d-4ec5-bcd7-485b275123d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:48.337893 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f5604f4f-d18d-4ec5-bcd7-485b275123d5 None None] MFA Rules not processed for user `8928566ff693460f8243c43078a6a575`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:53:48.340085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f5604f4f-d18d-4ec5-bcd7-485b275123d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:48.347464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1142/2283] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:53:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:53:49.071301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a2a4-9b38-4551-be79-bdf6cfe2aa32 service nova] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:49.072814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1fd5a2a4-9b38-4551-be79-bdf6cfe2aa32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:49.175843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a2a4-9b38-4551-be79-bdf6cfe2aa32 service nova] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:49.181651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07015dd4-d8db-468b-a6e1-0b89d634c787 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443fd569cd1b4f6db86d575ed669e26a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:49.182356 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07015dd4-d8db-468b-a6e1-0b89d634c787 service placement] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:49.182640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07015dd4-d8db-468b-a6e1-0b89d634c787 service placement] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:49.182924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07015dd4-d8db-468b-a6e1-0b89d634c787 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:49.185060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-07015dd4-d8db-468b-a6e1-0b89d634c787 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:49.197737 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07015dd4-d8db-468b-a6e1-0b89d634c787 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:49.199393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07015dd4-d8db-468b-a6e1-0b89d634c787 service placement] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:49.210641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1142/2284] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:53:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:53:51.350565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5604f4f-d18d-4ec5-bcd7-485b275123d5 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:53:51.352714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f5604f4f-d18d-4ec5-bcd7-485b275123d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:51.367888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5604f4f-d18d-4ec5-bcd7-485b275123d5 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:53:51.374435 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7689a-3f99-4de7-ae1a-6641e78da989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:53:51.375139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7689a-3f99-4de7-ae1a-6641e78da989 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:53:51.375437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7689a-3f99-4de7-ae1a-6641e78da989 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:53:51.375740 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7689a-3f99-4de7-ae1a-6641e78da989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:53:51.378185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1af7689a-3f99-4de7-ae1a-6641e78da989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:53:51.393350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7689a-3f99-4de7-ae1a-6641e78da989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:53:51.395951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7689a-3f99-4de7-ae1a-6641e78da989 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:53:51.411257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1143/2285] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:53:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:54:12.358552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52441bf6-a24f-43a7-b782-5c89b5a3940d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:12.359118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52441bf6-a24f-43a7-b782-5c89b5a3940d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:12.359118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52441bf6-a24f-43a7-b782-5c89b5a3940d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:12.376593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-52441bf6-a24f-43a7-b782-5c89b5a3940d None None] MFA Rules not processed for user `89539508b327427ba1a449fe30569606`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:12.377794 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-52441bf6-a24f-43a7-b782-5c89b5a3940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:12.438034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1143/2286] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:54:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:54:17.184191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7689a-3f99-4de7-ae1a-6641e78da989 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:17.185794 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1af7689a-3f99-4de7-ae1a-6641e78da989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:17.203076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7689a-3f99-4de7-ae1a-6641e78da989 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:17.209343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa359657-22d4-46a0-a544-fd6042b0eee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:17.210009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359657-22d4-46a0-a544-fd6042b0eee3 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:17.210303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359657-22d4-46a0-a544-fd6042b0eee3 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:17.210586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359657-22d4-46a0-a544-fd6042b0eee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:17.212994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-aa359657-22d4-46a0-a544-fd6042b0eee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:17.225200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa359657-22d4-46a0-a544-fd6042b0eee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:17.226824 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa359657-22d4-46a0-a544-fd6042b0eee3 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:17.237264 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1144/2287] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:54:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:54:20.275759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52441bf6-a24f-43a7-b782-5c89b5a3940d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:20.279395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-52441bf6-a24f-43a7-b782-5c89b5a3940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:20.293388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52441bf6-a24f-43a7-b782-5c89b5a3940d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:20.297890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91459a-da65-4280-be9a-8a1690c75b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:20.299055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91459a-da65-4280-be9a-8a1690c75b43 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:20.299496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91459a-da65-4280-be9a-8a1690c75b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:20.299809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91459a-da65-4280-be9a-8a1690c75b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:20.302138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8d91459a-da65-4280-be9a-8a1690c75b43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:20.394018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91459a-da65-4280-be9a-8a1690c75b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:20.398371 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91459a-da65-4280-be9a-8a1690c75b43 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:20.416960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1144/2288] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:54:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:54:23.966313 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa359657-22d4-46a0-a544-fd6042b0eee3 service nova] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:23.997969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa359657-22d4-46a0-a544-fd6042b0eee3 service nova] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:24.012315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85585bf3-3203-400d-9734-ac3106210fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:24.013485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85585bf3-3203-400d-9734-ac3106210fb4 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:24.014005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85585bf3-3203-400d-9734-ac3106210fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:24.014502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85585bf3-3203-400d-9734-ac3106210fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:24.016691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-85585bf3-3203-400d-9734-ac3106210fb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:24.044738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85585bf3-3203-400d-9734-ac3106210fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:24.046775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85585bf3-3203-400d-9734-ac3106210fb4 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:24.079636 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1145/2289] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:54:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:54:27.920405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f32b0-3fe9-48d0-898a-6bd011ef9234 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:27.921796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f32b0-3fe9-48d0-898a-6bd011ef9234 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:27.922237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f32b0-3fe9-48d0-898a-6bd011ef9234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:27.948362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-720f32b0-3fe9-48d0-898a-6bd011ef9234 None None] MFA Rules not processed for user `dab7aa55b2554d338cd76f34d03e1ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:27.949584 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-720f32b0-3fe9-48d0-898a-6bd011ef9234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:27.958437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1145/2290] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:54:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:54:28.358294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85585bf3-3203-400d-9734-ac3106210fb4 service nova] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:28.369601 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85585bf3-3203-400d-9734-ac3106210fb4 service nova] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:28.373727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbe418-2282-46c7-b108-29640e403b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:28.374481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbe418-2282-46c7-b108-29640e403b9d service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:28.374922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbe418-2282-46c7-b108-29640e403b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:28.375211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbe418-2282-46c7-b108-29640e403b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:28.377303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-51dbe418-2282-46c7-b108-29640e403b9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:28.389563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbe418-2282-46c7-b108-29640e403b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:28.391389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbe418-2282-46c7-b108-29640e403b9d service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:28.402233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1146/2291] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:54:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:54:33.478218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f32b0-3fe9-48d0-898a-6bd011ef9234 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:33.538306 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f32b0-3fe9-48d0-898a-6bd011ef9234 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:33.551642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e1778-6254-4c6e-b3c7-478463b800d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:33.552809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1778-6254-4c6e-b3c7-478463b800d8 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:33.553097 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1778-6254-4c6e-b3c7-478463b800d8 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:33.553375 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1778-6254-4c6e-b3c7-478463b800d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:33.559359 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-259e1778-6254-4c6e-b3c7-478463b800d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:33.601523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e1778-6254-4c6e-b3c7-478463b800d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:33.608410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e1778-6254-4c6e-b3c7-478463b800d8 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:33.640949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1146/2292] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:54:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:54:36.702201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8957dc0-61fe-4323-a43d-206b90108463 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:36.702880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8957dc0-61fe-4323-a43d-206b90108463 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:36.702880 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8957dc0-61fe-4323-a43d-206b90108463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:36.724490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b8957dc0-61fe-4323-a43d-206b90108463 None None] MFA Rules not processed for user `cd0d8acbe24d410690470e3d9d4882b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:36.726344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b8957dc0-61fe-4323-a43d-206b90108463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:36.735292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1147/2293] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:54:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:54:37.074139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e1778-6254-4c6e-b3c7-478463b800d8 service nova] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:37.086544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e1778-6254-4c6e-b3c7-478463b800d8 service nova] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:37.092547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f478b65-8038-4e87-91dc-361ff4031761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:37.093224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478b65-8038-4e87-91dc-361ff4031761 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:37.093525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478b65-8038-4e87-91dc-361ff4031761 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:37.093781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f478b65-8038-4e87-91dc-361ff4031761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:37.095824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8f478b65-8038-4e87-91dc-361ff4031761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:37.107088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f478b65-8038-4e87-91dc-361ff4031761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:37.108892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f478b65-8038-4e87-91dc-361ff4031761 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:37.119086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1147/2294] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:54:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:54:38.266360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b443af-e77e-402c-a348-501dfd72f1bf None None] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.267127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b443af-e77e-402c-a348-501dfd72f1bf None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.267127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b443af-e77e-402c-a348-501dfd72f1bf None None] PATH_INFO: `/` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.268300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1148/2295] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:54:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:38.277830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd89a-bebb-44d8-a7f8-6e0cdcdcad2d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.278390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd89a-bebb-44d8-a7f8-6e0cdcdcad2d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.278390 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd89a-bebb-44d8-a7f8-6e0cdcdcad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.307782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d15dd89a-bebb-44d8-a7f8-6e0cdcdcad2d None None] MFA Rules not processed for user `c22a0fc8a3914f7fb3356a84827db326`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:38.309374 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d15dd89a-bebb-44d8-a7f8-6e0cdcdcad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:38.323323 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1148/2296] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:54:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:54:38.340376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b443af-e77e-402c-a348-501dfd72f1bf None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:38.356522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b443af-e77e-402c-a348-501dfd72f1bf None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:38.364119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f78e8-7e1d-4e53-92e5-ca72517c6925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:38.365490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f78e8-7e1d-4e53-92e5-ca72517c6925 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.366031 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f78e8-7e1d-4e53-92e5-ca72517c6925 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.366511 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f78e8-7e1d-4e53-92e5-ca72517c6925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.382742 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f78e8-7e1d-4e53-92e5-ca72517c6925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:38.386716 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f78e8-7e1d-4e53-92e5-ca72517c6925 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:38.403909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1149/2297] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:54:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:54:38.832852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9b3bc-9f2a-4e4b-b6b5-16ea6eced34a None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.833467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9b3bc-9f2a-4e4b-b6b5-16ea6eced34a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.833871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9b3bc-9f2a-4e4b-b6b5-16ea6eced34a None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.836461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1149/2298] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:54:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:54:38.844447 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fca3e-1da0-4c00-8273-4b2a2490b06c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.844750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fca3e-1da0-4c00-8273-4b2a2490b06c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.845335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fca3e-1da0-4c00-8273-4b2a2490b06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.877444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-c48fca3e-1da0-4c00-8273-4b2a2490b06c None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:54:38.879036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c48fca3e-1da0-4c00-8273-4b2a2490b06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:38.892247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1150/2299] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:54:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:54:38.915290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9b3bc-9f2a-4e4b-b6b5-16ea6eced34a None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:38.930130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9b3bc-9f2a-4e4b-b6b5-16ea6eced34a None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:38.937327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7b387-4876-4a33-934c-5bf537d5a489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:38.938230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7b387-4876-4a33-934c-5bf537d5a489 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:38.938782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7b387-4876-4a33-934c-5bf537d5a489 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:38.939242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7b387-4876-4a33-934c-5bf537d5a489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:38.952806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7b387-4876-4a33-934c-5bf537d5a489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:38.954754 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7b387-4876-4a33-934c-5bf537d5a489 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:38.968442 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1150/2300] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:54:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:54:40.526627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fca3e-1da0-4c00-8273-4b2a2490b06c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:54:40.549397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fca3e-1da0-4c00-8273-4b2a2490b06c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:54:40.565224 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478ea75-83b4-4fb0-9c4e-f827ae335508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:54:40.566632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ea75-83b4-4fb0-9c4e-f827ae335508 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:54:40.567283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ea75-83b4-4fb0-9c4e-f827ae335508 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:54:40.567959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ea75-83b4-4fb0-9c4e-f827ae335508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:54:40.572083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9478ea75-83b4-4fb0-9c4e-f827ae335508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:54:40.613388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478ea75-83b4-4fb0-9c4e-f827ae335508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:54:40.617946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478ea75-83b4-4fb0-9c4e-f827ae335508 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:54:40.651228 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1151/2301] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:54:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:55:09.948423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2895a4-7713-443f-84bb-03e4df00f498 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:09.949152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2895a4-7713-443f-84bb-03e4df00f498 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:09.949152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2895a4-7713-443f-84bb-03e4df00f498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:09.976382 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-9b2895a4-7713-443f-84bb-03e4df00f498 None None] MFA Rules not processed for user `5e9ebfaac4984817bb768476ef74445c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:09.978251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9b2895a4-7713-443f-84bb-03e4df00f498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:10.042523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1151/2302] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:55:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:55:11.346588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e1615-31d5-48cd-8d59-4c71d8168ca8 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.347144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e1615-31d5-48cd-8d59-4c71d8168ca8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.347144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e1615-31d5-48cd-8d59-4c71d8168ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.371423 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0c0e1615-31d5-48cd-8d59-4c71d8168ca8 None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:11.373380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0c0e1615-31d5-48cd-8d59-4c71d8168ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:11.396588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1152/2303] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:55:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:55:11.465873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2895a4-7713-443f-84bb-03e4df00f498 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:11.486431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2895a4-7713-443f-84bb-03e4df00f498 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:11.495394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd786f7-91b6-482e-9762-9914edde2cc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:11.496199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd786f7-91b6-482e-9762-9914edde2cc0 service swift] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:11.496482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd786f7-91b6-482e-9762-9914edde2cc0 service swift] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:11.496739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd786f7-91b6-482e-9762-9914edde2cc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:11.507533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd786f7-91b6-482e-9762-9914edde2cc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:11.509749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd786f7-91b6-482e-9762-9914edde2cc0 service swift] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:11.520471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1152/2304] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:55:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:55:20.619615 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e1615-31d5-48cd-8d59-4c71d8168ca8 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:20.629098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e1615-31d5-48cd-8d59-4c71d8168ca8 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:20.634610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68989cb-e08e-4d4b-ac26-928cb96d5f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:20.636110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68989cb-e08e-4d4b-ac26-928cb96d5f28 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:20.636802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68989cb-e08e-4d4b-ac26-928cb96d5f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:20.637494 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68989cb-e08e-4d4b-ac26-928cb96d5f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:20.640436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b68989cb-e08e-4d4b-ac26-928cb96d5f28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:20.662018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68989cb-e08e-4d4b-ac26-928cb96d5f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:20.664091 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68989cb-e08e-4d4b-ac26-928cb96d5f28 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:20.674738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1153/2305] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:55:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:55:31.938859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7ea93-d270-4f4f-b626-e69dcdc3f207 None None] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.939266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7ea93-d270-4f4f-b626-e69dcdc3f207 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.939369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7ea93-d270-4f4f-b626-e69dcdc3f207 None None] PATH_INFO: `/` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.940924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1153/2306] 10.222.0.72 () {54 vars in 921 bytes} [Mon May 16 18:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 18:55:31.949812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e299-37ea-402b-8ae6-4192db686025 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:31.950355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e299-37ea-402b-8ae6-4192db686025 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:31.951250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e299-37ea-402b-8ae6-4192db686025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:31.995253 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1502e299-37ea-402b-8ae6-4192db686025 None None] MFA Rules not processed for user `cc09bfcc0d8c4d20a156b3b08ffafa34`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:31.996693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1502e299-37ea-402b-8ae6-4192db686025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:32.008486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1154/2307] 10.222.0.72 () {58 vars in 1018 bytes} [Mon May 16 18:55:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:55:32.022480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7ea93-d270-4f4f-b626-e69dcdc3f207 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:32.024726 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-68c7ea93-d270-4f4f-b626-e69dcdc3f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:32.181690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7ea93-d270-4f4f-b626-e69dcdc3f207 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:32.195777 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c68d-4326-4891-b17f-e42c14ec42f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0e623c10804239a076fc6cde9b198d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:32.197082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c68d-4326-4891-b17f-e42c14ec42f3 service glance] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:32.197819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c68d-4326-4891-b17f-e42c14ec42f3 service glance] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:32.198350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c68d-4326-4891-b17f-e42c14ec42f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:32.245516 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97c68d-4326-4891-b17f-e42c14ec42f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:32.248580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97c68d-4326-4891-b17f-e42c14ec42f3 service glance] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:32.283091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1154/2308] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:55:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:55:35.769643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08394728-01e3-43ed-849a-6e82e4ed14f9 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.770158 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08394728-01e3-43ed-849a-6e82e4ed14f9 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.770296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08394728-01e3-43ed-849a-6e82e4ed14f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.797272 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-08394728-01e3-43ed-849a-6e82e4ed14f9 None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:35.799238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-08394728-01e3-43ed-849a-6e82e4ed14f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:35.810478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1155/2309] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:55:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:55:35.842880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c68d-4326-4891-b17f-e42c14ec42f3 service glance] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:35.856525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c68d-4326-4891-b17f-e42c14ec42f3 service glance] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:35.862191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f31a3a-e229-4ff8-b8b7-074f4a5a384b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:35.863093 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f31a3a-e229-4ff8-b8b7-074f4a5a384b service swift] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:35.863378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f31a3a-e229-4ff8-b8b7-074f4a5a384b service swift] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:35.863690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f31a3a-e229-4ff8-b8b7-074f4a5a384b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:35.878775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f31a3a-e229-4ff8-b8b7-074f4a5a384b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:35.882058 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f31a3a-e229-4ff8-b8b7-074f4a5a384b service swift] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:35.893824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1155/2310] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:55:56.688938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18621992-144d-42d8-88ee-6ac83906b9d0 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:56.689588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18621992-144d-42d8-88ee-6ac83906b9d0 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:56.689694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18621992-144d-42d8-88ee-6ac83906b9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:56.716131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-18621992-144d-42d8-88ee-6ac83906b9d0 None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:55:56.718542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-18621992-144d-42d8-88ee-6ac83906b9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:56.731689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1156/2311] 10.222.0.72 () {58 vars in 967 bytes} [Mon May 16 18:55:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:55:56.749823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f31a3a-e229-4ff8-b8b7-074f4a5a384b service swift] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:56.767846 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f31a3a-e229-4ff8-b8b7-074f4a5a384b service swift] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:56.777829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276d47b-0b81-4a0e-b4c0-7878be50dc71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:56.778991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276d47b-0b81-4a0e-b4c0-7878be50dc71 service swift] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:56.779509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276d47b-0b81-4a0e-b4c0-7878be50dc71 service swift] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:56.780065 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276d47b-0b81-4a0e-b4c0-7878be50dc71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:56.797719 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276d47b-0b81-4a0e-b4c0-7878be50dc71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:56.800750 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276d47b-0b81-4a0e-b4c0-7878be50dc71 service swift] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:56.816257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1156/2312] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:55:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 18:55:59.725575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18621992-144d-42d8-88ee-6ac83906b9d0 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:55:59.735842 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18621992-144d-42d8-88ee-6ac83906b9d0 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:55:59.741308 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69704e9-59d0-4c45-bc26-ae2c80fc19a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:55:59.741969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69704e9-59d0-4c45-bc26-ae2c80fc19a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:55:59.742246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69704e9-59d0-4c45-bc26-ae2c80fc19a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:55:59.742548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69704e9-59d0-4c45-bc26-ae2c80fc19a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:55:59.744404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d69704e9-59d0-4c45-bc26-ae2c80fc19a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:55:59.814753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69704e9-59d0-4c45-bc26-ae2c80fc19a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:55:59.816168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69704e9-59d0-4c45-bc26-ae2c80fc19a5 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:55:59.826183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1157/2313] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:03.822428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276d47b-0b81-4a0e-b4c0-7878be50dc71 service swift] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:03.825751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d276d47b-0b81-4a0e-b4c0-7878be50dc71 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:03.840945 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276d47b-0b81-4a0e-b4c0-7878be50dc71 service swift] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:03.845974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c74413-77fb-42e3-98ac-af8c8eb8ad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:03.846893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c74413-77fb-42e3-98ac-af8c8eb8ad93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:03.847174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c74413-77fb-42e3-98ac-af8c8eb8ad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:03.847471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c74413-77fb-42e3-98ac-af8c8eb8ad93 admin admin] PATH_INFO: `/v3/users/89539508b327427ba1a449fe30569606` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:03.849353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c74413-77fb-42e3-98ac-af8c8eb8ad93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89539508b327427ba1a449fe30569606)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:03.851312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c74413-77fb-42e3-98ac-af8c8eb8ad93 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:03.901104 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e9c74413-77fb-42e3-98ac-af8c8eb8ad93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89539508b327427ba1a449fe30569606'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:03.914229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e9c74413-77fb-42e3-98ac-af8c8eb8ad93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89539508b327427ba1a449fe30569606'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:03.914956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e9c74413-77fb-42e3-98ac-af8c8eb8ad93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89539508b327427ba1a449fe30569606'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:03.923249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e9c74413-77fb-42e3-98ac-af8c8eb8ad93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89539508b327427ba1a449fe30569606'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:03.930297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e9c74413-77fb-42e3-98ac-af8c8eb8ad93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89539508b327427ba1a449fe30569606'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:03.938227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1157/2314] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:03 2022] DELETE /identity/v3/users/89539508b327427ba1a449fe30569606 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:04.138146 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69704e9-59d0-4c45-bc26-ae2c80fc19a5 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.150519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69704e9-59d0-4c45-bc26-ae2c80fc19a5 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.232709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.234060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.234522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.234974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] PATH_INFO: `/v3/projects/9fe0e3c0f5eb4d4199f084be233eb1d3` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.236916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe0e3c0f5eb4d4199f084be233eb1d3)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.240796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.304018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'request_id': 'req-81eb2498-33b0-4292-bb2f-40138305e176'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:04.314668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'request_id': 'req-81eb2498-33b0-4292-bb2f-40138305e176'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:04.324395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe0e3c0f5eb4d4199f084be233eb1d3', 'request_id': 'req-81eb2498-33b0-4292-bb2f-40138305e176'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:04.335046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] The token cache is being invalidate because project 9fe0e3c0f5eb4d4199f084be233eb1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:04.335334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:04.336244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-81eb2498-33b0-4292-bb2f-40138305e176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:04.337817 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1158/2315] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:04 2022] DELETE /identity/v3/projects/9fe0e3c0f5eb4d4199f084be233eb1d3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:04.345183 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2c136-9c1e-4f1e-928f-cda78e5e9dea None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.345796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2c136-9c1e-4f1e-928f-cda78e5e9dea None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.346836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2c136-9c1e-4f1e-928f-cda78e5e9dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.370740 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-40c2c136-9c1e-4f1e-928f-cda78e5e9dea None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:04.372939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-40c2c136-9c1e-4f1e-928f-cda78e5e9dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:04.446417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1158/2316] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:04.455367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa75d5-9bd2-432a-864d-9b3ebf27025c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.455785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa75d5-9bd2-432a-864d-9b3ebf27025c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.456085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa75d5-9bd2-432a-864d-9b3ebf27025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.484789 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-3eaa75d5-9bd2-432a-864d-9b3ebf27025c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:04.486923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3eaa75d5-9bd2-432a-864d-9b3ebf27025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:04.500371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1159/2317] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:04.505173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2c136-9c1e-4f1e-928f-cda78e5e9dea None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.515033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2c136-9c1e-4f1e-928f-cda78e5e9dea None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.519643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f081fb2-ee37-464b-9deb-49e7ac81f54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.520872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081fb2-ee37-464b-9deb-49e7ac81f54c admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.521153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081fb2-ee37-464b-9deb-49e7ac81f54c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.521447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081fb2-ee37-464b-9deb-49e7ac81f54c admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.522184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f081fb2-ee37-464b-9deb-49e7ac81f54c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:04.522485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f081fb2-ee37-464b-9deb-49e7ac81f54c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.524121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f081fb2-ee37-464b-9deb-49e7ac81f54c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.536574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1159/2318] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:04.541048 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa75d5-9bd2-432a-864d-9b3ebf27025c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.550253 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa75d5-9bd2-432a-864d-9b3ebf27025c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.555313 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0df93-3836-4670-8ad0-ead8743f6b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.556028 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0df93-3836-4670-8ad0-ead8743f6b1c admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.556325 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0df93-3836-4670-8ad0-ead8743f6b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.556701 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0df93-3836-4670-8ad0-ead8743f6b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.557344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0df93-3836-4670-8ad0-ead8743f6b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.559497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0df93-3836-4670-8ad0-ead8743f6b1c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.607778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1160/2319] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:04 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:04.609368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f081fb2-ee37-464b-9deb-49e7ac81f54c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.627959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f081fb2-ee37-464b-9deb-49e7ac81f54c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.710164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c8baa-941f-4e75-95ff-ada9ad715b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.710748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c8baa-941f-4e75-95ff-ada9ad715b96 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.711030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c8baa-941f-4e75-95ff-ada9ad715b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.711304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c8baa-941f-4e75-95ff-ada9ad715b96 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.712228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c8baa-941f-4e75-95ff-ada9ad715b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.714309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c8baa-941f-4e75-95ff-ada9ad715b96 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.750796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1160/2320] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:04 2022] POST /identity/v3/users => generated 282 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:04.756001 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0df93-3836-4670-8ad0-ead8743f6b1c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.767555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0df93-3836-4670-8ad0-ead8743f6b1c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.773455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f998f9-6ad5-4c2e-a4dd-138a7a09d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.774171 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f998f9-6ad5-4c2e-a4dd-138a7a09d47b admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.774455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f998f9-6ad5-4c2e-a4dd-138a7a09d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.774742 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f998f9-6ad5-4c2e-a4dd-138a7a09d47b admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.775518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f998f9-6ad5-4c2e-a4dd-138a7a09d47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.777206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f998f9-6ad5-4c2e-a4dd-138a7a09d47b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.789433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1161/2321] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:04.795362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c8baa-941f-4e75-95ff-ada9ad715b96 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.811964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c8baa-941f-4e75-95ff-ada9ad715b96 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.817381 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84938d88-4926-4e93-8f5f-0dc3d7ddfb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.818069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84938d88-4926-4e93-8f5f-0dc3d7ddfb2e admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.818348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84938d88-4926-4e93-8f5f-0dc3d7ddfb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.818626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84938d88-4926-4e93-8f5f-0dc3d7ddfb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.819402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84938d88-4926-4e93-8f5f-0dc3d7ddfb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.821020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84938d88-4926-4e93-8f5f-0dc3d7ddfb2e admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.831394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1161/2322] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:04.836150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f998f9-6ad5-4c2e-a4dd-138a7a09d47b admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:04.846277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f998f9-6ad5-4c2e-a4dd-138a7a09d47b admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:04.858095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ac800-67a6-41d9-b106-fa23514580cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:04.859632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac800-67a6-41d9-b106-fa23514580cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.860026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac800-67a6-41d9-b106-fa23514580cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.860315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac800-67a6-41d9-b106-fa23514580cb admin admin] PATH_INFO: `/v3/projects/eeedafd5f5f7420b945de286b925f403/users/88f13c1f68074ab1b02cb9b9f7085364/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.875895 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ac800-67a6-41d9-b106-fa23514580cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeedafd5f5f7420b945de286b925f403, user_id=88f13c1f68074ab1b02cb9b9f7085364, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:04.878657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ac800-67a6-41d9-b106-fa23514580cb admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:04.892881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1162/2323] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:04 2022] PUT /identity/v3/projects/eeedafd5f5f7420b945de286b925f403/users/88f13c1f68074ab1b02cb9b9f7085364/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:04.904531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4616e-35f7-49e6-af5d-429fdd3427b5 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:04.904821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4616e-35f7-49e6-af5d-429fdd3427b5 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:04.905101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4616e-35f7-49e6-af5d-429fdd3427b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:04.935913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2ad4616e-35f7-49e6-af5d-429fdd3427b5 None None] MFA Rules not processed for user `88f13c1f68074ab1b02cb9b9f7085364`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:04.937139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2ad4616e-35f7-49e6-af5d-429fdd3427b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:05.008020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1162/2324] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:05.012750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ac800-67a6-41d9-b106-fa23514580cb admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:05.084610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ac800-67a6-41d9-b106-fa23514580cb admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:05.089633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdaa24-48a9-450a-be3a-f0cd7a118492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:05.090248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdaa24-48a9-450a-be3a-f0cd7a118492 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:05.090527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdaa24-48a9-450a-be3a-f0cd7a118492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:05.090801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdaa24-48a9-450a-be3a-f0cd7a118492 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:05.091770 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdaa24-48a9-450a-be3a-f0cd7a118492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:05.093783 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdaa24-48a9-450a-be3a-f0cd7a118492 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:05.131834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1163/2325] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:05 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:56:05.133766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4616e-35f7-49e6-af5d-429fdd3427b5 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:05.149292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4616e-35f7-49e6-af5d-429fdd3427b5 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:05.217135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51610d-909d-4c9a-91d9-d6926cabb48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:05.217906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51610d-909d-4c9a-91d9-d6926cabb48c admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:05.218135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51610d-909d-4c9a-91d9-d6926cabb48c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:05.218629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51610d-909d-4c9a-91d9-d6926cabb48c admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:05.219540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51610d-909d-4c9a-91d9-d6926cabb48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:05.221403 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51610d-909d-4c9a-91d9-d6926cabb48c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:05.244446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1163/2326] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:05 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:05.248672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdaa24-48a9-450a-be3a-f0cd7a118492 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:05.260966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdaa24-48a9-450a-be3a-f0cd7a118492 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:05.266299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa9f67-2522-485c-a6f1-5bc22d2ae57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:05.266901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa9f67-2522-485c-a6f1-5bc22d2ae57c admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:05.267214 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa9f67-2522-485c-a6f1-5bc22d2ae57c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:05.270066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa9f67-2522-485c-a6f1-5bc22d2ae57c admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:05.270066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa9f67-2522-485c-a6f1-5bc22d2ae57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:05.270066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa9f67-2522-485c-a6f1-5bc22d2ae57c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:05.288974 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1164/2327] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:05.291285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51610d-909d-4c9a-91d9-d6926cabb48c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:05.303964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51610d-909d-4c9a-91d9-d6926cabb48c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:05.309124 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c681e-f912-44df-bb5e-f2654cfb4976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:05.309953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c681e-f912-44df-bb5e-f2654cfb4976 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:05.310235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c681e-f912-44df-bb5e-f2654cfb4976 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:05.310511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c681e-f912-44df-bb5e-f2654cfb4976 admin admin] PATH_INFO: `/v3/projects/5d8b98618cc74290ab97aa3447dda606/users/90a05e14119b4221a010a776f10cc581/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:05.326806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c681e-f912-44df-bb5e-f2654cfb4976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8b98618cc74290ab97aa3447dda606, user_id=90a05e14119b4221a010a776f10cc581, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:05.329534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c681e-f912-44df-bb5e-f2654cfb4976 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:05.344507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1164/2328] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:05 2022] PUT /identity/v3/projects/5d8b98618cc74290ab97aa3447dda606/users/90a05e14119b4221a010a776f10cc581/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:05.349486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa9f67-2522-485c-a6f1-5bc22d2ae57c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:05.359634 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa9f67-2522-485c-a6f1-5bc22d2ae57c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:05.418994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28063a69-9d17-48cf-9111-03c23b4f5f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:05.419896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28063a69-9d17-48cf-9111-03c23b4f5f06 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:05.420241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28063a69-9d17-48cf-9111-03c23b4f5f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:05.420563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28063a69-9d17-48cf-9111-03c23b4f5f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:05.421821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28063a69-9d17-48cf-9111-03c23b4f5f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:05.423551 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28063a69-9d17-48cf-9111-03c23b4f5f06 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:05.434982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1165/2329] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:56:05.439495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c681e-f912-44df-bb5e-f2654cfb4976 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:05.450618 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c681e-f912-44df-bb5e-f2654cfb4976 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:05.455809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47f0be-784d-4ec7-ba51-fafcce7aefd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:05.456723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f0be-784d-4ec7-ba51-fafcce7aefd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:05.457005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f0be-784d-4ec7-ba51-fafcce7aefd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:05.457288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f0be-784d-4ec7-ba51-fafcce7aefd9 admin admin] PATH_INFO: `/v3/projects/5d8b98618cc74290ab97aa3447dda606/users/90a05e14119b4221a010a776f10cc581/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:05.460646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47f0be-784d-4ec7-ba51-fafcce7aefd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8b98618cc74290ab97aa3447dda606, user_id=90a05e14119b4221a010a776f10cc581, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:05.463355 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47f0be-784d-4ec7-ba51-fafcce7aefd9 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:05.478361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1165/2330] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:05 2022] PUT /identity/v3/projects/5d8b98618cc74290ab97aa3447dda606/users/90a05e14119b4221a010a776f10cc581/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:05.489018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b00180-63f3-4b20-8250-9d01c1170cae None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:05.489380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b00180-63f3-4b20-8250-9d01c1170cae None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:05.490355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b00180-63f3-4b20-8250-9d01c1170cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:05.537772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d6b00180-63f3-4b20-8250-9d01c1170cae None None] MFA Rules not processed for user `90a05e14119b4221a010a776f10cc581`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:05.538998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d6b00180-63f3-4b20-8250-9d01c1170cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:05.625398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1166/2331] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:05.643266 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47f0be-784d-4ec7-ba51-fafcce7aefd9 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:05.645057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2a47f0be-784d-4ec7-ba51-fafcce7aefd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:05.732961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47f0be-784d-4ec7-ba51-fafcce7aefd9 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:05.737504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789d1ce-028b-4e27-bf7d-a9eacd2e9317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:05.738220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d1ce-028b-4e27-bf7d-a9eacd2e9317 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:05.738602 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d1ce-028b-4e27-bf7d-a9eacd2e9317 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:05.739635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d1ce-028b-4e27-bf7d-a9eacd2e9317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:05.752303 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789d1ce-028b-4e27-bf7d-a9eacd2e9317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:05.753981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789d1ce-028b-4e27-bf7d-a9eacd2e9317 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:05.765038 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1166/2332] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:05.849689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b00180-63f3-4b20-8250-9d01c1170cae None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:05.861084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b00180-63f3-4b20-8250-9d01c1170cae None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:05.865774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c7cd1-c31a-4653-88a2-ff00ebf96553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:05.866441 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c7cd1-c31a-4653-88a2-ff00ebf96553 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:05.866752 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c7cd1-c31a-4653-88a2-ff00ebf96553 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:05.867239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c7cd1-c31a-4653-88a2-ff00ebf96553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:05.938093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c7cd1-c31a-4653-88a2-ff00ebf96553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:05.939781 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c7cd1-c31a-4653-88a2-ff00ebf96553 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:05.960520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1167/2333] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:15.287339 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789d1ce-028b-4e27-bf7d-a9eacd2e9317 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:15.353961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789d1ce-028b-4e27-bf7d-a9eacd2e9317 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:15.359726 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:15.360667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:15.360947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:15.361219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] PATH_INFO: `/v3/users/88f13c1f68074ab1b02cb9b9f7085364` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:15.363004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f13c1f68074ab1b02cb9b9f7085364)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:15.366066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:15.436571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f13c1f68074ab1b02cb9b9f7085364'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:15.448469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f13c1f68074ab1b02cb9b9f7085364'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:15.449222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f13c1f68074ab1b02cb9b9f7085364'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:15.456609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f13c1f68074ab1b02cb9b9f7085364'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:15.464170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f13c1f68074ab1b02cb9b9f7085364'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:15.470742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1167/2334] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:15 2022] DELETE /identity/v3/users/88f13c1f68074ab1b02cb9b9f7085364 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:15.476170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab02f4-3164-4a8f-9947-a409551e6b52 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:15.476676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab02f4-3164-4a8f-9947-a409551e6b52 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:15.476803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab02f4-3164-4a8f-9947-a409551e6b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:15.498217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d6ab02f4-3164-4a8f-9947-a409551e6b52 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:15.499423 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d6ab02f4-3164-4a8f-9947-a409551e6b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:15.562788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1168/2335] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:15.573174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:15.574600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:15.640938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a46f8-2fef-4c89-ad8d-7918c9ed41e5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:15.644631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047f8c0-0031-4128-b602-73dfb965e0c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:15.645288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047f8c0-0031-4128-b602-73dfb965e0c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:15.645565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047f8c0-0031-4128-b602-73dfb965e0c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:15.645837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047f8c0-0031-4128-b602-73dfb965e0c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:15.656166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047f8c0-0031-4128-b602-73dfb965e0c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:15.657605 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047f8c0-0031-4128-b602-73dfb965e0c1 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:15.668471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1168/2336] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:16.040914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab02f4-3164-4a8f-9947-a409551e6b52 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:16.042800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d6ab02f4-3164-4a8f-9947-a409551e6b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:16.057492 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab02f4-3164-4a8f-9947-a409551e6b52 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:16.066351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:16.067829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:16.068195 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:16.068584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] PATH_INFO: `/v3/projects/eeedafd5f5f7420b945de286b925f403` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:16.070339 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeedafd5f5f7420b945de286b925f403)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:16.072870 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:16.134705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeedafd5f5f7420b945de286b925f403', 'request_id': 'req-d08f05f4-a878-4432-9021-ca817266b18f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.141647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeedafd5f5f7420b945de286b925f403', 'request_id': 'req-d08f05f4-a878-4432-9021-ca817266b18f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.153464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeedafd5f5f7420b945de286b925f403', 'request_id': 'req-d08f05f4-a878-4432-9021-ca817266b18f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.166321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] The token cache is being invalidate because project eeedafd5f5f7420b945de286b925f403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:16.166640 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.167393 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.169054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1169/2337] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:16 2022] DELETE /identity/v3/projects/eeedafd5f5f7420b945de286b925f403 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:16.174153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047f8c0-0031-4128-b602-73dfb965e0c1 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:16.184021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047f8c0-0031-4128-b602-73dfb965e0c1 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:16.249623 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e8eb7-8ea6-4d55-8bdd-db241b2a798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:16.250518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e8eb7-8ea6-4d55-8bdd-db241b2a798c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:16.250797 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e8eb7-8ea6-4d55-8bdd-db241b2a798c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:16.251072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e8eb7-8ea6-4d55-8bdd-db241b2a798c admin admin] PATH_INFO: `/v3/users/90a05e14119b4221a010a776f10cc581` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:16.252480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e8eb7-8ea6-4d55-8bdd-db241b2a798c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a05e14119b4221a010a776f10cc581)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:16.254972 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e8eb7-8ea6-4d55-8bdd-db241b2a798c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:16.323040 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d93e8eb7-8ea6-4d55-8bdd-db241b2a798c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a05e14119b4221a010a776f10cc581'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.337873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d93e8eb7-8ea6-4d55-8bdd-db241b2a798c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a05e14119b4221a010a776f10cc581'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.338620 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d93e8eb7-8ea6-4d55-8bdd-db241b2a798c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a05e14119b4221a010a776f10cc581'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.347558 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d93e8eb7-8ea6-4d55-8bdd-db241b2a798c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a05e14119b4221a010a776f10cc581'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.355990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d93e8eb7-8ea6-4d55-8bdd-db241b2a798c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a05e14119b4221a010a776f10cc581'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.362092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1169/2338] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:16 2022] DELETE /identity/v3/users/90a05e14119b4221a010a776f10cc581 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:16.666832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:16.669112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:16.692396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f05f4-a878-4432-9021-ca817266b18f admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:16.766970 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:16.767895 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:16.768189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:16.768474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] PATH_INFO: `/v3/projects/5d8b98618cc74290ab97aa3447dda606` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:16.769839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8b98618cc74290ab97aa3447dda606)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:16.771884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:16.824995 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8b98618cc74290ab97aa3447dda606', 'request_id': 'req-93528bb8-306e-43c3-961a-b2251ab0d13c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.831609 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8b98618cc74290ab97aa3447dda606', 'request_id': 'req-93528bb8-306e-43c3-961a-b2251ab0d13c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.840089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8b98618cc74290ab97aa3447dda606', 'request_id': 'req-93528bb8-306e-43c3-961a-b2251ab0d13c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.855054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] The token cache is being invalidate because project 5d8b98618cc74290ab97aa3447dda606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:16.855304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.856234 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-93528bb8-306e-43c3-961a-b2251ab0d13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:16.858487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1170/2339] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:16 2022] DELETE /identity/v3/projects/5d8b98618cc74290ab97aa3447dda606 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:16.864813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d622e-f746-4fb0-afd0-6bb30f8da1f6 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:16.865118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d622e-f746-4fb0-afd0-6bb30f8da1f6 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:16.865391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d622e-f746-4fb0-afd0-6bb30f8da1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:16.884656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-3c4d622e-f746-4fb0-afd0-6bb30f8da1f6 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:16.885851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3c4d622e-f746-4fb0-afd0-6bb30f8da1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:16.958838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1170/2340] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:16.968722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed2b7-f6bf-4637-83c0-78203126fce8 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:16.969064 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed2b7-f6bf-4637-83c0-78203126fce8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:16.969267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed2b7-f6bf-4637-83c0-78203126fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:16.993590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-aa4ed2b7-f6bf-4637-83c0-78203126fce8 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:16.994971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-aa4ed2b7-f6bf-4637-83c0-78203126fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:17.008452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1171/2341] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:17.012735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d622e-f746-4fb0-afd0-6bb30f8da1f6 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:17.023938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d622e-f746-4fb0-afd0-6bb30f8da1f6 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:17.031224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea34bc-8793-461d-be98-de4ed8122823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:17.032060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea34bc-8793-461d-be98-de4ed8122823 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:17.032419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea34bc-8793-461d-be98-de4ed8122823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:17.032770 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea34bc-8793-461d-be98-de4ed8122823 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:17.033653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea34bc-8793-461d-be98-de4ed8122823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:17.033965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea34bc-8793-461d-be98-de4ed8122823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:17.037326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea34bc-8793-461d-be98-de4ed8122823 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:17.050744 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1171/2342] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:17.058277 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ed2b7-f6bf-4637-83c0-78203126fce8 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:17.069813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ed2b7-f6bf-4637-83c0-78203126fce8 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:17.075495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774d5c0-5ba8-40ff-84bc-697ad8123628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:17.077829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774d5c0-5ba8-40ff-84bc-697ad8123628 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:17.077829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774d5c0-5ba8-40ff-84bc-697ad8123628 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:17.078100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774d5c0-5ba8-40ff-84bc-697ad8123628 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:17.078636 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774d5c0-5ba8-40ff-84bc-697ad8123628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:17.080875 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774d5c0-5ba8-40ff-84bc-697ad8123628 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:17.117629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1172/2343] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:17 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:17.122856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea34bc-8793-461d-be98-de4ed8122823 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:17.133701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea34bc-8793-461d-be98-de4ed8122823 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:17.200829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a074bb-3255-4b6a-bcd5-1bbf786cb72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:17.202119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a074bb-3255-4b6a-bcd5-1bbf786cb72d admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:17.202530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a074bb-3255-4b6a-bcd5-1bbf786cb72d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:17.202814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a074bb-3255-4b6a-bcd5-1bbf786cb72d admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:17.203510 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a074bb-3255-4b6a-bcd5-1bbf786cb72d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:17.205693 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a074bb-3255-4b6a-bcd5-1bbf786cb72d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:17.229620 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1172/2344] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:17 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:17.234167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774d5c0-5ba8-40ff-84bc-697ad8123628 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:17.244978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774d5c0-5ba8-40ff-84bc-697ad8123628 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:17.250155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f061e-c254-484e-b4e7-e053c569b1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:17.251022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f061e-c254-484e-b4e7-e053c569b1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:17.251308 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f061e-c254-484e-b4e7-e053c569b1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:17.251599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f061e-c254-484e-b4e7-e053c569b1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:17.252355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f061e-c254-484e-b4e7-e053c569b1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:17.253953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f061e-c254-484e-b4e7-e053c569b1e3 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:17.264926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1173/2345] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:17.269627 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a074bb-3255-4b6a-bcd5-1bbf786cb72d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:17.280431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a074bb-3255-4b6a-bcd5-1bbf786cb72d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:17.286093 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4064ac6-a175-4ef6-83d4-0400a52a3689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:17.286889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4064ac6-a175-4ef6-83d4-0400a52a3689 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:17.287244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4064ac6-a175-4ef6-83d4-0400a52a3689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:17.287649 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4064ac6-a175-4ef6-83d4-0400a52a3689 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:17.288872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4064ac6-a175-4ef6-83d4-0400a52a3689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:17.291037 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4064ac6-a175-4ef6-83d4-0400a52a3689 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:17.301965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1173/2346] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:17.306120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f061e-c254-484e-b4e7-e053c569b1e3 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:17.316071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f061e-c254-484e-b4e7-e053c569b1e3 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:17.321148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cec1d9-c584-46e4-88a5-8bc73854a758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:17.322035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cec1d9-c584-46e4-88a5-8bc73854a758 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:17.322315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cec1d9-c584-46e4-88a5-8bc73854a758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:17.322591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cec1d9-c584-46e4-88a5-8bc73854a758 admin admin] PATH_INFO: `/v3/projects/e19b47a9e180499eab997b44a61be529/users/374f57e683a848ce894ec9ca9d3d20c3/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:17.338095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cec1d9-c584-46e4-88a5-8bc73854a758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19b47a9e180499eab997b44a61be529, user_id=374f57e683a848ce894ec9ca9d3d20c3, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:17.340808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cec1d9-c584-46e4-88a5-8bc73854a758 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:17.359243 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1174/2347] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:17 2022] PUT /identity/v3/projects/e19b47a9e180499eab997b44a61be529/users/374f57e683a848ce894ec9ca9d3d20c3/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:17.371005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68483879-23c0-4c71-bbaa-b4acb4532919 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:17.371540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68483879-23c0-4c71-bbaa-b4acb4532919 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:17.371656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68483879-23c0-4c71-bbaa-b4acb4532919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:17.400000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-68483879-23c0-4c71-bbaa-b4acb4532919 None None] MFA Rules not processed for user `374f57e683a848ce894ec9ca9d3d20c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:17.401212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-68483879-23c0-4c71-bbaa-b4acb4532919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:17.470350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1174/2348] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:17.482713 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cec1d9-c584-46e4-88a5-8bc73854a758 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:17.484749 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-05cec1d9-c584-46e4-88a5-8bc73854a758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:17.545872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cec1d9-c584-46e4-88a5-8bc73854a758 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:17.552162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf4020-6704-49a9-839e-6c821a5b0be3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0e623c10804239a076fc6cde9b198d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:17.552949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf4020-6704-49a9-839e-6c821a5b0be3 service glance] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:17.553405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf4020-6704-49a9-839e-6c821a5b0be3 service glance] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:17.553881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf4020-6704-49a9-839e-6c821a5b0be3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:17.566153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf4020-6704-49a9-839e-6c821a5b0be3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:17.568652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf4020-6704-49a9-839e-6c821a5b0be3 service glance] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:17.592347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1175/2349] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:24.190233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68483879-23c0-4c71-bbaa-b4acb4532919 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:24.192492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-68483879-23c0-4c71-bbaa-b4acb4532919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:24.270857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68483879-23c0-4c71-bbaa-b4acb4532919 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:24.278467 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9ee17-12f3-4d8a-a4bd-d46183199f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:24.279167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9ee17-12f3-4d8a-a4bd-d46183199f4c service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:24.279450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9ee17-12f3-4d8a-a4bd-d46183199f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:24.279776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9ee17-12f3-4d8a-a4bd-d46183199f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:24.281822 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e8a9ee17-12f3-4d8a-a4bd-d46183199f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:24.376609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9ee17-12f3-4d8a-a4bd-d46183199f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:24.378067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9ee17-12f3-4d8a-a4bd-d46183199f4c service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:24.389763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1175/2350] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:28.997452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf4020-6704-49a9-839e-6c821a5b0be3 service glance] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:28.999229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1bcf4020-6704-49a9-839e-6c821a5b0be3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:29.016983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf4020-6704-49a9-839e-6c821a5b0be3 service glance] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:29.022894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c0be0-b241-4f8a-8637-c0f1110870c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:29.023815 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c0be0-b241-4f8a-8637-c0f1110870c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:29.024100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c0be0-b241-4f8a-8637-c0f1110870c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:29.024375 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c0be0-b241-4f8a-8637-c0f1110870c7 admin admin] PATH_INFO: `/v3/users/cd0d8acbe24d410690470e3d9d4882b1` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:29.025605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c0be0-b241-4f8a-8637-c0f1110870c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0d8acbe24d410690470e3d9d4882b1)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:29.027564 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c0be0-b241-4f8a-8637-c0f1110870c7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:29.092624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d43c0be0-b241-4f8a-8637-c0f1110870c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0d8acbe24d410690470e3d9d4882b1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:29.106137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d43c0be0-b241-4f8a-8637-c0f1110870c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0d8acbe24d410690470e3d9d4882b1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:29.106878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d43c0be0-b241-4f8a-8637-c0f1110870c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0d8acbe24d410690470e3d9d4882b1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:29.107518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d43c0be0-b241-4f8a-8637-c0f1110870c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0d8acbe24d410690470e3d9d4882b1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:29.116758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d43c0be0-b241-4f8a-8637-c0f1110870c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0d8acbe24d410690470e3d9d4882b1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:29.132886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1176/2351] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:28 2022] DELETE /identity/v3/users/cd0d8acbe24d410690470e3d9d4882b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:29.382365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9ee17-12f3-4d8a-a4bd-d46183199f4c service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:29.397095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9ee17-12f3-4d8a-a4bd-d46183199f4c service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:29.482605 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:29.483505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:29.483862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:29.484147 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] PATH_INFO: `/v3/projects/593c7b69cbad453499aacad0ad6e64ae` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:29.485753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=593c7b69cbad453499aacad0ad6e64ae)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:29.487596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:29.548691 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593c7b69cbad453499aacad0ad6e64ae', 'request_id': 'req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:29.559392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593c7b69cbad453499aacad0ad6e64ae', 'request_id': 'req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:29.569347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593c7b69cbad453499aacad0ad6e64ae', 'request_id': 'req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:29.584321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] The token cache is being invalidate because project 593c7b69cbad453499aacad0ad6e64ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:29.584729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:29.585799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-7a0a48dc-23fe-4d0b-8931-74d7333c48cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:29.588565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1176/2352] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:29 2022] DELETE /identity/v3/projects/593c7b69cbad453499aacad0ad6e64ae => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:29.594323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ee284-1a95-41b6-9587-ee8d5832db45 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:29.594620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ee284-1a95-41b6-9587-ee8d5832db45 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:29.594923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ee284-1a95-41b6-9587-ee8d5832db45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:29.620086 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-310ee284-1a95-41b6-9587-ee8d5832db45 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:29.621326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-310ee284-1a95-41b6-9587-ee8d5832db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:29.687504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1177/2353] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:29.696497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3fe90-2cf0-41a3-95f3-7e88034dcc63 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:29.697030 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3fe90-2cf0-41a3-95f3-7e88034dcc63 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:29.697307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3fe90-2cf0-41a3-95f3-7e88034dcc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:29.719412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c7e3fe90-2cf0-41a3-95f3-7e88034dcc63 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:29.719821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c7e3fe90-2cf0-41a3-95f3-7e88034dcc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:29.730521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1177/2354] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:29.736324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ee284-1a95-41b6-9587-ee8d5832db45 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:29.747593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ee284-1a95-41b6-9587-ee8d5832db45 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:29.752290 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6abebd-a596-489a-9872-043d17ef4726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:29.753005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6abebd-a596-489a-9872-043d17ef4726 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:29.753238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6abebd-a596-489a-9872-043d17ef4726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:29.754440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6abebd-a596-489a-9872-043d17ef4726 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:29.754942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6abebd-a596-489a-9872-043d17ef4726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:29.755321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6abebd-a596-489a-9872-043d17ef4726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:29.757369 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6abebd-a596-489a-9872-043d17ef4726 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:29.772559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1178/2355] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:29.776900 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3fe90-2cf0-41a3-95f3-7e88034dcc63 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:29.787152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3fe90-2cf0-41a3-95f3-7e88034dcc63 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:29.792379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c842773-e707-4692-866e-c250a12916f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:29.793094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c842773-e707-4692-866e-c250a12916f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:29.793376 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c842773-e707-4692-866e-c250a12916f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:29.793650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c842773-e707-4692-866e-c250a12916f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:29.794433 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c842773-e707-4692-866e-c250a12916f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:29.796571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c842773-e707-4692-866e-c250a12916f9 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:29.828923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1178/2356] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:29 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:29.834501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6abebd-a596-489a-9872-043d17ef4726 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:29.846958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6abebd-a596-489a-9872-043d17ef4726 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:29.931351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb2673-8eef-451d-97b0-dd80987525a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:29.932455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2673-8eef-451d-97b0-dd80987525a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:29.933058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2673-8eef-451d-97b0-dd80987525a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:29.933538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2673-8eef-451d-97b0-dd80987525a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:29.934736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb2673-8eef-451d-97b0-dd80987525a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:29.937726 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb2673-8eef-451d-97b0-dd80987525a6 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:29.966706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1179/2357] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:29 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:29.968098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c842773-e707-4692-866e-c250a12916f9 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:29.991685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c842773-e707-4692-866e-c250a12916f9 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:29.998540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c2a9e-825e-49a3-8919-f8a005621539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:29.999544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c2a9e-825e-49a3-8919-f8a005621539 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:30.000000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c2a9e-825e-49a3-8919-f8a005621539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:30.000401 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c2a9e-825e-49a3-8919-f8a005621539 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:30.001541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c2a9e-825e-49a3-8919-f8a005621539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:30.004162 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c2a9e-825e-49a3-8919-f8a005621539 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:30.023811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1179/2358] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:30.025254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb2673-8eef-451d-97b0-dd80987525a6 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:30.044967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb2673-8eef-451d-97b0-dd80987525a6 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:30.056924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59045-b9ab-4813-8299-afcdc0ee746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:30.057634 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59045-b9ab-4813-8299-afcdc0ee746a admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:30.058169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59045-b9ab-4813-8299-afcdc0ee746a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:30.058459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59045-b9ab-4813-8299-afcdc0ee746a admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:30.059272 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e59045-b9ab-4813-8299-afcdc0ee746a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:30.061073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e59045-b9ab-4813-8299-afcdc0ee746a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:30.075685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1180/2359] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:30.081397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c2a9e-825e-49a3-8919-f8a005621539 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:30.094402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c2a9e-825e-49a3-8919-f8a005621539 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:30.100000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdb915-00e1-44ba-93ff-1751ac6007ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:30.100960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb915-00e1-44ba-93ff-1751ac6007ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:30.101184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb915-00e1-44ba-93ff-1751ac6007ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:30.101460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb915-00e1-44ba-93ff-1751ac6007ef admin admin] PATH_INFO: `/v3/projects/9493713ede544b85b5440cfd2caeeb78/users/8ead2cf642fb40a89e6866d147bc3f47/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:30.118190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdb915-00e1-44ba-93ff-1751ac6007ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9493713ede544b85b5440cfd2caeeb78, user_id=8ead2cf642fb40a89e6866d147bc3f47, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:30.120904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdb915-00e1-44ba-93ff-1751ac6007ef admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:30.136091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1180/2360] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:30 2022] PUT /identity/v3/projects/9493713ede544b85b5440cfd2caeeb78/users/8ead2cf642fb40a89e6866d147bc3f47/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:30.148636 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481a740-c931-425e-a2c3-5be9d9c5fc09 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:30.149097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481a740-c931-425e-a2c3-5be9d9c5fc09 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:30.149574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481a740-c931-425e-a2c3-5be9d9c5fc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:30.186935 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4481a740-c931-425e-a2c3-5be9d9c5fc09 None None] MFA Rules not processed for user `8ead2cf642fb40a89e6866d147bc3f47`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:30.188198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4481a740-c931-425e-a2c3-5be9d9c5fc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:30.268690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1181/2361] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:30.280951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdb915-00e1-44ba-93ff-1751ac6007ef admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:30.282709 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-31fdb915-00e1-44ba-93ff-1751ac6007ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:30.351288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdb915-00e1-44ba-93ff-1751ac6007ef admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:30.356914 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08ea70-de76-4316-a6dd-37c4d1ae54d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:30.357586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08ea70-de76-4316-a6dd-37c4d1ae54d6 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:30.357863 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08ea70-de76-4316-a6dd-37c4d1ae54d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:30.358136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08ea70-de76-4316-a6dd-37c4d1ae54d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:30.368911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08ea70-de76-4316-a6dd-37c4d1ae54d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:30.370996 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08ea70-de76-4316-a6dd-37c4d1ae54d6 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:30.385392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1181/2362] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:30.530201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481a740-c931-425e-a2c3-5be9d9c5fc09 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:30.532212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4481a740-c931-425e-a2c3-5be9d9c5fc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:30.613816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481a740-c931-425e-a2c3-5be9d9c5fc09 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:30.624946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce915e8-2ece-493f-b771-eb9a891695ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:30.626355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce915e8-2ece-493f-b771-eb9a891695ee service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:30.627005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce915e8-2ece-493f-b771-eb9a891695ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:30.627572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce915e8-2ece-493f-b771-eb9a891695ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:30.631448 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0ce915e8-2ece-493f-b771-eb9a891695ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:30.735589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce915e8-2ece-493f-b771-eb9a891695ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:30.737535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce915e8-2ece-493f-b771-eb9a891695ee service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:30.751261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1182/2363] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:32.641197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08ea70-de76-4316-a6dd-37c4d1ae54d6 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:32.644253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5f08ea70-de76-4316-a6dd-37c4d1ae54d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:32.663920 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08ea70-de76-4316-a6dd-37c4d1ae54d6 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:32.669180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ae43b-f4c8-4663-b660-75dca7491972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:32.670358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ae43b-f4c8-4663-b660-75dca7491972 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:32.670880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ae43b-f4c8-4663-b660-75dca7491972 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:32.671396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ae43b-f4c8-4663-b660-75dca7491972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:32.674701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-857ae43b-f4c8-4663-b660-75dca7491972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:32.792444 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ae43b-f4c8-4663-b660-75dca7491972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:32.794634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ae43b-f4c8-4663-b660-75dca7491972 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:32.825604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1182/2364] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:36.006682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce915e8-2ece-493f-b771-eb9a891695ee service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:36.010342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0ce915e8-2ece-493f-b771-eb9a891695ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:36.039222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce915e8-2ece-493f-b771-eb9a891695ee service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:36.044932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0999b-89de-4f63-914f-96fbed5dc17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:36.046256 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0999b-89de-4f63-914f-96fbed5dc17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:36.047041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0999b-89de-4f63-914f-96fbed5dc17a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:36.047536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0999b-89de-4f63-914f-96fbed5dc17a admin admin] PATH_INFO: `/v3/users/dab7aa55b2554d338cd76f34d03e1ef2` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:36.049767 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0999b-89de-4f63-914f-96fbed5dc17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab7aa55b2554d338cd76f34d03e1ef2)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:36.057136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0999b-89de-4f63-914f-96fbed5dc17a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:36.143865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-8bc0999b-89de-4f63-914f-96fbed5dc17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab7aa55b2554d338cd76f34d03e1ef2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:36.160217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-8bc0999b-89de-4f63-914f-96fbed5dc17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab7aa55b2554d338cd76f34d03e1ef2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:36.161019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-8bc0999b-89de-4f63-914f-96fbed5dc17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab7aa55b2554d338cd76f34d03e1ef2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:36.161632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-8bc0999b-89de-4f63-914f-96fbed5dc17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab7aa55b2554d338cd76f34d03e1ef2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:36.171553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-8bc0999b-89de-4f63-914f-96fbed5dc17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab7aa55b2554d338cd76f34d03e1ef2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:36.194437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1183/2365] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:36 2022] DELETE /identity/v3/users/dab7aa55b2554d338cd76f34d03e1ef2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:36.500701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ae43b-f4c8-4663-b660-75dca7491972 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:36.532290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ae43b-f4c8-4663-b660-75dca7491972 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:36.638539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:36.641994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:36.641994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:36.641994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] PATH_INFO: `/v3/projects/75d882994e2c443fb1d9104ccbfb8c7f` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:36.642565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d882994e2c443fb1d9104ccbfb8c7f)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:36.645764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:36.731408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d882994e2c443fb1d9104ccbfb8c7f', 'request_id': 'req-c12a6b7f-3f4f-457a-9f40-cf04202d1679'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:36.739961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d882994e2c443fb1d9104ccbfb8c7f', 'request_id': 'req-c12a6b7f-3f4f-457a-9f40-cf04202d1679'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:36.749519 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d882994e2c443fb1d9104ccbfb8c7f', 'request_id': 'req-c12a6b7f-3f4f-457a-9f40-cf04202d1679'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:36.761296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] The token cache is being invalidate because project 75d882994e2c443fb1d9104ccbfb8c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:36.761591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:36.762265 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c12a6b7f-3f4f-457a-9f40-cf04202d1679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:36.763887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1183/2366] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:36 2022] DELETE /identity/v3/projects/75d882994e2c443fb1d9104ccbfb8c7f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:36.771855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ad9a1-fe86-4815-a194-c1ec131bb708 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:36.772444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ad9a1-fe86-4815-a194-c1ec131bb708 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:36.772787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ad9a1-fe86-4815-a194-c1ec131bb708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:36.812783 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-850ad9a1-fe86-4815-a194-c1ec131bb708 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:36.814861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-850ad9a1-fe86-4815-a194-c1ec131bb708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:36.932715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1184/2367] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:36.945136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44084e-408a-4e11-a5bd-ed8d0a8c596b None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:36.945648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44084e-408a-4e11-a5bd-ed8d0a8c596b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:36.946243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44084e-408a-4e11-a5bd-ed8d0a8c596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:36.984383 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-1d44084e-408a-4e11-a5bd-ed8d0a8c596b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:36.986074 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1d44084e-408a-4e11-a5bd-ed8d0a8c596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:36.996845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1184/2368] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:37.002976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ad9a1-fe86-4815-a194-c1ec131bb708 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:37.015498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ad9a1-fe86-4815-a194-c1ec131bb708 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:37.022484 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7606f-21e7-44e9-8226-fb39c924755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:37.023270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7606f-21e7-44e9-8226-fb39c924755d admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:37.023658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7606f-21e7-44e9-8226-fb39c924755d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:37.024104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7606f-21e7-44e9-8226-fb39c924755d admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:37.025222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7606f-21e7-44e9-8226-fb39c924755d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:37.025863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7606f-21e7-44e9-8226-fb39c924755d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:37.028100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7606f-21e7-44e9-8226-fb39c924755d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:37.048107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1185/2369] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:37.053299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44084e-408a-4e11-a5bd-ed8d0a8c596b None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:37.071653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44084e-408a-4e11-a5bd-ed8d0a8c596b None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:37.080080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee44978-3289-410f-b033-c04501296dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:37.081268 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44978-3289-410f-b033-c04501296dcd admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:37.081858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44978-3289-410f-b033-c04501296dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:37.082287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44978-3289-410f-b033-c04501296dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:37.083872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee44978-3289-410f-b033-c04501296dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:37.087514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee44978-3289-410f-b033-c04501296dcd admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:37.128646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1185/2370] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:37 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:37.134788 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7606f-21e7-44e9-8226-fb39c924755d admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:37.146100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7606f-21e7-44e9-8226-fb39c924755d admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:37.255766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d8243-1355-4f10-9d71-1e46bbe276b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:37.256977 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d8243-1355-4f10-9d71-1e46bbe276b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:37.257312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d8243-1355-4f10-9d71-1e46bbe276b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:37.257651 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d8243-1355-4f10-9d71-1e46bbe276b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:37.258472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d8243-1355-4f10-9d71-1e46bbe276b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:37.260628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d8243-1355-4f10-9d71-1e46bbe276b4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:37.286220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1186/2371] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:37 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:37.291053 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee44978-3289-410f-b033-c04501296dcd admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:37.307452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee44978-3289-410f-b033-c04501296dcd admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:37.314336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259cc81-81c1-4cc7-88b6-13c1398ed57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:37.315052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259cc81-81c1-4cc7-88b6-13c1398ed57d admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:37.315365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259cc81-81c1-4cc7-88b6-13c1398ed57d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:37.315716 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259cc81-81c1-4cc7-88b6-13c1398ed57d admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:37.317630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259cc81-81c1-4cc7-88b6-13c1398ed57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:37.319291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259cc81-81c1-4cc7-88b6-13c1398ed57d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:37.334479 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1186/2372] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:56:37.338872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d8243-1355-4f10-9d71-1e46bbe276b4 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:37.350850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d8243-1355-4f10-9d71-1e46bbe276b4 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:37.356116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a0c5f-f4fc-4fbd-951c-61ffbed513e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:37.356791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a0c5f-f4fc-4fbd-951c-61ffbed513e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:37.357084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a0c5f-f4fc-4fbd-951c-61ffbed513e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:37.357345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a0c5f-f4fc-4fbd-951c-61ffbed513e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:37.358077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a0c5f-f4fc-4fbd-951c-61ffbed513e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:37.359664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a0c5f-f4fc-4fbd-951c-61ffbed513e0 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:37.372321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1187/2373] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:37.377309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259cc81-81c1-4cc7-88b6-13c1398ed57d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:37.391828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259cc81-81c1-4cc7-88b6-13c1398ed57d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:37.398873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ac15a-ab66-46c8-b624-f2d2b72f12a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:37.400062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ac15a-ab66-46c8-b624-f2d2b72f12a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:37.400590 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ac15a-ab66-46c8-b624-f2d2b72f12a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:37.400957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ac15a-ab66-46c8-b624-f2d2b72f12a6 admin admin] PATH_INFO: `/v3/projects/d6af9d4f1491494baf8a01fc111d041b/users/31b47f666fb945428ddb9aa0672bc8db/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:37.422152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ac15a-ab66-46c8-b624-f2d2b72f12a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6af9d4f1491494baf8a01fc111d041b, user_id=31b47f666fb945428ddb9aa0672bc8db, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:37.427077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ac15a-ab66-46c8-b624-f2d2b72f12a6 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:37.451450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1187/2374] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:37 2022] PUT /identity/v3/projects/d6af9d4f1491494baf8a01fc111d041b/users/31b47f666fb945428ddb9aa0672bc8db/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:37.458953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a44b65-a2b7-42bf-a8be-c04334f36f57 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:37.459240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a44b65-a2b7-42bf-a8be-c04334f36f57 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:37.459513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a44b65-a2b7-42bf-a8be-c04334f36f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:37.489397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-89a44b65-a2b7-42bf-a8be-c04334f36f57 None None] MFA Rules not processed for user `31b47f666fb945428ddb9aa0672bc8db`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:37.491594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-89a44b65-a2b7-42bf-a8be-c04334f36f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:37.600886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1188/2375] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:37.610568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ac15a-ab66-46c8-b624-f2d2b72f12a6 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:37.612644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-628ac15a-ab66-46c8-b624-f2d2b72f12a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:37.721232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ac15a-ab66-46c8-b624-f2d2b72f12a6 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:37.731142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978f3f8-e713-42f1-b1a4-f9e8f26e07a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:37.733067 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f3f8-e713-42f1-b1a4-f9e8f26e07a4 service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:37.733358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f3f8-e713-42f1-b1a4-f9e8f26e07a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:37.733639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f3f8-e713-42f1-b1a4-f9e8f26e07a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:37.763430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978f3f8-e713-42f1-b1a4-f9e8f26e07a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:37.766843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978f3f8-e713-42f1-b1a4-f9e8f26e07a4 service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:37.793762 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1188/2376] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:38.107459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a44b65-a2b7-42bf-a8be-c04334f36f57 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:38.221430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a44b65-a2b7-42bf-a8be-c04334f36f57 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:38.229396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:38.229396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:38.229396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:38.229396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] PATH_INFO: `/v3/users/31b47f666fb945428ddb9aa0672bc8db` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:38.230856 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b47f666fb945428ddb9aa0672bc8db)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:38.232982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:38.296329 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b47f666fb945428ddb9aa0672bc8db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:38.315084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b47f666fb945428ddb9aa0672bc8db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:38.316214 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b47f666fb945428ddb9aa0672bc8db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:38.317268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b47f666fb945428ddb9aa0672bc8db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:38.329009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b47f666fb945428ddb9aa0672bc8db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:38.347102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1189/2377] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:38 2022] DELETE /identity/v3/users/31b47f666fb945428ddb9aa0672bc8db => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:38.352392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca2c71-739d-46db-bd95-3781fc254b23 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:38.352676 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca2c71-739d-46db-bd95-3781fc254b23 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:38.352929 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca2c71-739d-46db-bd95-3781fc254b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:38.374824 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2cca2c71-739d-46db-bd95-3781fc254b23 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:38.377048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2cca2c71-739d-46db-bd95-3781fc254b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:38.471379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1189/2378] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:38.481235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:38.483878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:38.574873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68d2b8-8577-4f95-b34d-37ba61785775 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:38.588622 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c4ee9-3cc5-4979-9d5f-b0c622e293a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:38.589781 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c4ee9-3cc5-4979-9d5f-b0c622e293a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:38.590158 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c4ee9-3cc5-4979-9d5f-b0c622e293a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:38.590480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c4ee9-3cc5-4979-9d5f-b0c622e293a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:38.603569 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c4ee9-3cc5-4979-9d5f-b0c622e293a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:38.605089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c4ee9-3cc5-4979-9d5f-b0c622e293a4 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:38.616383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1190/2379] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:56:39.038131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca2c71-739d-46db-bd95-3781fc254b23 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:39.040690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2cca2c71-739d-46db-bd95-3781fc254b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:39.056236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca2c71-739d-46db-bd95-3781fc254b23 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:39.064393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:39.064899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c4ee9-3cc5-4979-9d5f-b0c622e293a4 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:39.066604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.067416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.067968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-de4c4ee9-3cc5-4979-9d5f-b0c622e293a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:39.068174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] PATH_INFO: `/v3/projects/d6af9d4f1491494baf8a01fc111d041b` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.069923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6af9d4f1491494baf8a01fc111d041b)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:39.072365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:39.091057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c4ee9-3cc5-4979-9d5f-b0c622e293a4 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:39.104801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224622-3719-4839-8131-710914abbedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:39.104801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224622-3719-4839-8131-710914abbedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.104801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224622-3719-4839-8131-710914abbedb admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.104801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224622-3719-4839-8131-710914abbedb admin admin] PATH_INFO: `/v3/users/374f57e683a848ce894ec9ca9d3d20c3` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.105990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1224622-3719-4839-8131-710914abbedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=374f57e683a848ce894ec9ca9d3d20c3)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:39.108941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1224622-3719-4839-8131-710914abbedb admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:39.169089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6af9d4f1491494baf8a01fc111d041b', 'request_id': 'req-d217a475-c2fd-44d3-8ecb-77b33afcd774'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:39.183980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f1224622-3719-4839-8131-710914abbedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '374f57e683a848ce894ec9ca9d3d20c3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:39.197385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6af9d4f1491494baf8a01fc111d041b', 'request_id': 'req-d217a475-c2fd-44d3-8ecb-77b33afcd774'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:39.212585 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6af9d4f1491494baf8a01fc111d041b', 'request_id': 'req-d217a475-c2fd-44d3-8ecb-77b33afcd774'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:39.212804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f1224622-3719-4839-8131-710914abbedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '374f57e683a848ce894ec9ca9d3d20c3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:39.213546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f1224622-3719-4839-8131-710914abbedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '374f57e683a848ce894ec9ca9d3d20c3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:39.214199 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f1224622-3719-4839-8131-710914abbedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '374f57e683a848ce894ec9ca9d3d20c3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:39.225938 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f1224622-3719-4839-8131-710914abbedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '374f57e683a848ce894ec9ca9d3d20c3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:39.231430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] The token cache is being invalidate because project d6af9d4f1491494baf8a01fc111d041b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:39.232036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:39.233450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-d217a475-c2fd-44d3-8ecb-77b33afcd774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:39.236471 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1190/2380] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:39 2022] DELETE /identity/v3/projects/d6af9d4f1491494baf8a01fc111d041b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:39.241270 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb651d8-b269-4425-980a-ff03fc4f8618 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.242350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb651d8-b269-4425-980a-ff03fc4f8618 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.242917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb651d8-b269-4425-980a-ff03fc4f8618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.268123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-0bb651d8-b269-4425-980a-ff03fc4f8618 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:39.271361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0bb651d8-b269-4425-980a-ff03fc4f8618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:39.276202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1191/2381] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:39 2022] DELETE /identity/v3/users/374f57e683a848ce894ec9ca9d3d20c3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:39.278318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdf72b-013d-4001-b8f0-739e0e511a2c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.278737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdf72b-013d-4001-b8f0-739e0e511a2c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.279220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdf72b-013d-4001-b8f0-739e0e511a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.305040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-13bdf72b-013d-4001-b8f0-739e0e511a2c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:39.308503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-13bdf72b-013d-4001-b8f0-739e0e511a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:39.408296 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1191/2382] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:39.411381 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf3080-e849-4e5c-b073-939735103d00 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.411919 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf3080-e849-4e5c-b073-939735103d00 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.412446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf3080-e849-4e5c-b073-939735103d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.432531 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1192/2383] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:39.443688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdf72b-013d-4001-b8f0-739e0e511a2c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:39.445988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-13bdf72b-013d-4001-b8f0-739e0e511a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:39.450736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d1cf3080-e849-4e5c-b073-939735103d00 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:39.452417 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d1cf3080-e849-4e5c-b073-939735103d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:39.472765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1192/2384] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:39.473531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf3080-e849-4e5c-b073-939735103d00 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:39.490910 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf3080-e849-4e5c-b073-939735103d00 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:39.497491 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316113d-d80f-4e3f-9782-d915822e7e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:39.498197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316113d-d80f-4e3f-9782-d915822e7e90 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.498549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316113d-d80f-4e3f-9782-d915822e7e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.498894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316113d-d80f-4e3f-9782-d915822e7e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.499746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316113d-d80f-4e3f-9782-d915822e7e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:39.500145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316113d-d80f-4e3f-9782-d915822e7e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:39.501866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316113d-d80f-4e3f-9782-d915822e7e90 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:39.515496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1193/2385] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:39.521847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316113d-d80f-4e3f-9782-d915822e7e90 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:39.522711 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdf72b-013d-4001-b8f0-739e0e511a2c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:39.526920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a907a44-c5d3-4d6a-9eb2-39616c6f7207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:39.527591 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a907a44-c5d3-4d6a-9eb2-39616c6f7207 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.527934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a907a44-c5d3-4d6a-9eb2-39616c6f7207 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.528229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a907a44-c5d3-4d6a-9eb2-39616c6f7207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.535288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316113d-d80f-4e3f-9782-d915822e7e90 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:39.540018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a907a44-c5d3-4d6a-9eb2-39616c6f7207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:39.541945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a907a44-c5d3-4d6a-9eb2-39616c6f7207 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:39.542204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e530a0-9648-481e-ae47-b0d8d15c6848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:39.543221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e530a0-9648-481e-ae47-b0d8d15c6848 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.543658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e530a0-9648-481e-ae47-b0d8d15c6848 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.544131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e530a0-9648-481e-ae47-b0d8d15c6848 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.545039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e530a0-9648-481e-ae47-b0d8d15c6848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:39.547088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e530a0-9648-481e-ae47-b0d8d15c6848 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:39.553669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1193/2386] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:39.607944 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1194/2387] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:39 2022] POST /identity/v3/projects => generated 403 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:39.614942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a907a44-c5d3-4d6a-9eb2-39616c6f7207 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:39.632042 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a907a44-c5d3-4d6a-9eb2-39616c6f7207 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:39.718947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27e0b3-31e8-4e66-912b-acdbd0c2f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:39.720661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27e0b3-31e8-4e66-912b-acdbd0c2f72f admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.721198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27e0b3-31e8-4e66-912b-acdbd0c2f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.721690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27e0b3-31e8-4e66-912b-acdbd0c2f72f admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.722618 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27e0b3-31e8-4e66-912b-acdbd0c2f72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:39.725131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27e0b3-31e8-4e66-912b-acdbd0c2f72f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:39.747756 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1194/2388] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:39 2022] POST /identity/v3/users => generated 302 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:39.752509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e530a0-9648-481e-ae47-b0d8d15c6848 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:39.765530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e530a0-9648-481e-ae47-b0d8d15c6848 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:39.771439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01533d99-24d6-41b6-9a56-a4e6ef7f37f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:39.772174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01533d99-24d6-41b6-9a56-a4e6ef7f37f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.772454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01533d99-24d6-41b6-9a56-a4e6ef7f37f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.772733 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01533d99-24d6-41b6-9a56-a4e6ef7f37f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.773484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01533d99-24d6-41b6-9a56-a4e6ef7f37f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:39.775889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01533d99-24d6-41b6-9a56-a4e6ef7f37f8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:39.788364 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1195/2389] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:39.794029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27e0b3-31e8-4e66-912b-acdbd0c2f72f admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:39.812470 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27e0b3-31e8-4e66-912b-acdbd0c2f72f admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:39.820251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effea78-e215-4348-8e4f-0a52fbeb1d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:39.820961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effea78-e215-4348-8e4f-0a52fbeb1d45 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.822811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effea78-e215-4348-8e4f-0a52fbeb1d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.823315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effea78-e215-4348-8e4f-0a52fbeb1d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.825652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effea78-e215-4348-8e4f-0a52fbeb1d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:39.826017 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effea78-e215-4348-8e4f-0a52fbeb1d45 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:39.841497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1195/2390] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:39.848672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01533d99-24d6-41b6-9a56-a4e6ef7f37f8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:39.865890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01533d99-24d6-41b6-9a56-a4e6ef7f37f8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:39.881837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b705b6-81c1-4a73-9d95-1cd3761431f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:39.883561 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b705b6-81c1-4a73-9d95-1cd3761431f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.885101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b705b6-81c1-4a73-9d95-1cd3761431f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.885702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b705b6-81c1-4a73-9d95-1cd3761431f4 admin admin] PATH_INFO: `/v3/projects/24dc59ab57ae456ea079ed1de15f7323/users/99ea78bcfb6c42c69df3a98e29b4aff5/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:39.909101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b705b6-81c1-4a73-9d95-1cd3761431f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dc59ab57ae456ea079ed1de15f7323, user_id=99ea78bcfb6c42c69df3a98e29b4aff5, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:39.913942 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b705b6-81c1-4a73-9d95-1cd3761431f4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:39.939054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1196/2391] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:39 2022] PUT /identity/v3/projects/24dc59ab57ae456ea079ed1de15f7323/users/99ea78bcfb6c42c69df3a98e29b4aff5/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:39.954759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce1eb-8862-4006-a304-4192b73d8d48 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:39.954759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce1eb-8862-4006-a304-4192b73d8d48 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:39.955095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce1eb-8862-4006-a304-4192b73d8d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.003072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b705b6-81c1-4a73-9d95-1cd3761431f4 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.008844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-830ce1eb-8862-4006-a304-4192b73d8d48 None None] MFA Rules not processed for user `99ea78bcfb6c42c69df3a98e29b4aff5`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:40.008844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-830ce1eb-8862-4006-a304-4192b73d8d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.009869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-80b705b6-81c1-4a73-9d95-1cd3761431f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.099234 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1196/2392] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:40.107189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce1eb-8862-4006-a304-4192b73d8d48 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.115473 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b705b6-81c1-4a73-9d95-1cd3761431f4 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.119096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce1eb-8862-4006-a304-4192b73d8d48 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.120423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.121295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.121575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.121847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] PATH_INFO: `/v3/projects/e19b47a9e180499eab997b44a61be529` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.123029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19b47a9e180499eab997b44a61be529)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.124985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.125140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d23c4c-0f69-485e-aaf4-79192f7bba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.125775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d23c4c-0f69-485e-aaf4-79192f7bba08 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.126058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d23c4c-0f69-485e-aaf4-79192f7bba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.126331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d23c4c-0f69-485e-aaf4-79192f7bba08 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.127022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d23c4c-0f69-485e-aaf4-79192f7bba08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.129233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d23c4c-0f69-485e-aaf4-79192f7bba08 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.164887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1197/2393] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:40 2022] POST /identity/v3/projects => generated 403 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:56:40.169984 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d23c4c-0f69-485e-aaf4-79192f7bba08 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.187735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19b47a9e180499eab997b44a61be529', 'request_id': 'req-dd78e934-86ca-4a24-bba3-96dc5684d587'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:40.197060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19b47a9e180499eab997b44a61be529', 'request_id': 'req-dd78e934-86ca-4a24-bba3-96dc5684d587'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:40.206877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19b47a9e180499eab997b44a61be529', 'request_id': 'req-dd78e934-86ca-4a24-bba3-96dc5684d587'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:40.221205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] The token cache is being invalidate because project e19b47a9e180499eab997b44a61be529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:40.221497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:40.223315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd78e934-86ca-4a24-bba3-96dc5684d587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:40.225092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1197/2394] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:40 2022] DELETE /identity/v3/projects/e19b47a9e180499eab997b44a61be529 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:40.234785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb4faa-714c-4614-be87-482eeb22de2a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.234785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb4faa-714c-4614-be87-482eeb22de2a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.234785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb4faa-714c-4614-be87-482eeb22de2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.257337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-0ccb4faa-714c-4614-be87-482eeb22de2a None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:40.258613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0ccb4faa-714c-4614-be87-482eeb22de2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.287262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d23c4c-0f69-485e-aaf4-79192f7bba08 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.346597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1198/2395] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:40.346597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb4faa-714c-4614-be87-482eeb22de2a None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.346597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0ccb4faa-714c-4614-be87-482eeb22de2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.358855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e980b-fd99-4783-a2df-798b89b7dfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.359482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e980b-fd99-4783-a2df-798b89b7dfcb admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.359921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e980b-fd99-4783-a2df-798b89b7dfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.360311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e980b-fd99-4783-a2df-798b89b7dfcb admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.361204 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e980b-fd99-4783-a2df-798b89b7dfcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.362070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb4faa-714c-4614-be87-482eeb22de2a None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.364474 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e980b-fd99-4783-a2df-798b89b7dfcb admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.371421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.372804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.373191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.373571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] PATH_INFO: `/v3/users/8ead2cf642fb40a89e6866d147bc3f47` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.375858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ead2cf642fb40a89e6866d147bc3f47)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.379279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.389344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1198/2396] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:40 2022] POST /identity/v3/users => generated 308 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:56:40.390991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60158168-22e8-4faf-9815-db14500e893b None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.391659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60158168-22e8-4faf-9815-db14500e893b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.392293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60158168-22e8-4faf-9815-db14500e893b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.421153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-60158168-22e8-4faf-9815-db14500e893b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:40.423173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-60158168-22e8-4faf-9815-db14500e893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.435965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1199/2397] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:40.437766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60158168-22e8-4faf-9815-db14500e893b None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.441637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-60158168-22e8-4faf-9815-db14500e893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.457951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60158168-22e8-4faf-9815-db14500e893b None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.463535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b15af4-8435-4bf3-9475-822fe042a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.464284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b15af4-8435-4bf3-9475-822fe042a4ba admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.464566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b15af4-8435-4bf3-9475-822fe042a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.464850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b15af4-8435-4bf3-9475-822fe042a4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.465150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ead2cf642fb40a89e6866d147bc3f47'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:40.465686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b15af4-8435-4bf3-9475-822fe042a4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.467759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b15af4-8435-4bf3-9475-822fe042a4ba admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.480836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1200/2398] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:40.481779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b15af4-8435-4bf3-9475-822fe042a4ba admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.482487 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ead2cf642fb40a89e6866d147bc3f47'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:40.484775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ead2cf642fb40a89e6866d147bc3f47'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:40.498179 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b15af4-8435-4bf3-9475-822fe042a4ba admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.501580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ead2cf642fb40a89e6866d147bc3f47'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:40.507197 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c2352-fba3-4925-b14f-c2661b8539bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.507918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c2352-fba3-4925-b14f-c2661b8539bb admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.508204 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c2352-fba3-4925-b14f-c2661b8539bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.508481 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c2352-fba3-4925-b14f-c2661b8539bb admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.509550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c2352-fba3-4925-b14f-c2661b8539bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:40.509550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c2352-fba3-4925-b14f-c2661b8539bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.511232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c2352-fba3-4925-b14f-c2661b8539bb admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.512078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ead2cf642fb40a89e6866d147bc3f47'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:40.518791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1199/2399] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:40 2022] DELETE /identity/v3/users/8ead2cf642fb40a89e6866d147bc3f47 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:40.519930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.522181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.535360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1201/2400] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:40.537518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffa4e7-f17b-4537-ab0c-bbae3029cc87 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.538589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffa4e7-f17b-4537-ab0c-bbae3029cc87 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.539398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffa4e7-f17b-4537-ab0c-bbae3029cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.570134 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-89ffa4e7-f17b-4537-ab0c-bbae3029cc87 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:40.571858 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-89ffa4e7-f17b-4537-ab0c-bbae3029cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.623268 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297567f0-9a19-4581-9af0-a943695b381d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.644350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc7f85-4433-4f26-9718-cf49d8392e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.645831 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc7f85-4433-4f26-9718-cf49d8392e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.646133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc7f85-4433-4f26-9718-cf49d8392e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.646418 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc7f85-4433-4f26-9718-cf49d8392e94 admin admin] PATH_INFO: `/v3/projects/82809e43dbd0467b9ef652c2a14efdb2/users/abb2ffa72c6e4a21a0fe6e25c8ed9255/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.671655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1202/2401] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:40.671655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffa4e7-f17b-4537-ab0c-bbae3029cc87 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.671655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-89ffa4e7-f17b-4537-ab0c-bbae3029cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.686150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc7f85-4433-4f26-9718-cf49d8392e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82809e43dbd0467b9ef652c2a14efdb2, user_id=abb2ffa72c6e4a21a0fe6e25c8ed9255, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.691948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc7f85-4433-4f26-9718-cf49d8392e94 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.695262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffa4e7-f17b-4537-ab0c-bbae3029cc87 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.719176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1200/2402] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:40 2022] PUT /identity/v3/projects/82809e43dbd0467b9ef652c2a14efdb2/users/abb2ffa72c6e4a21a0fe6e25c8ed9255/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:40.719176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc7f85-4433-4f26-9718-cf49d8392e94 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.724090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d0b62-8204-4c77-930a-b0a298b08ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.724818 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d0b62-8204-4c77-930a-b0a298b08ded admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.725112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d0b62-8204-4c77-930a-b0a298b08ded admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.725395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d0b62-8204-4c77-930a-b0a298b08ded admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.725958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a6bc7f85-4433-4f26-9718-cf49d8392e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.726142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d0b62-8204-4c77-930a-b0a298b08ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.728341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d0b62-8204-4c77-930a-b0a298b08ded admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.765933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1203/2403] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:40 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:40.767104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d0b62-8204-4c77-930a-b0a298b08ded admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.815146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc7f85-4433-4f26-9718-cf49d8392e94 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.845736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d0b62-8204-4c77-930a-b0a298b08ded admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.853182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d8fe7-ab88-4e67-810b-ef194ab6f4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.853868 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d8fe7-ab88-4e67-810b-ef194ab6f4ee admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.854154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d8fe7-ab88-4e67-810b-ef194ab6f4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.854439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d8fe7-ab88-4e67-810b-ef194ab6f4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.855179 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d8fe7-ab88-4e67-810b-ef194ab6f4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.856881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d8fe7-ab88-4e67-810b-ef194ab6f4ee admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.868036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1204/2404] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:40.868847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d8fe7-ab88-4e67-810b-ef194ab6f4ee admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.873478 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcd318-e2c3-4645-8550-b5e9067dc129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.874137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcd318-e2c3-4645-8550-b5e9067dc129 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.874407 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcd318-e2c3-4645-8550-b5e9067dc129 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.874685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcd318-e2c3-4645-8550-b5e9067dc129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.882095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d8fe7-ab88-4e67-810b-ef194ab6f4ee admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.886363 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcd318-e2c3-4645-8550-b5e9067dc129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.886629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f3f84-2769-4211-9668-59166d9e2664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.887040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f3f84-2769-4211-9668-59166d9e2664 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.887334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f3f84-2769-4211-9668-59166d9e2664 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.887612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f3f84-2769-4211-9668-59166d9e2664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.888050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcd318-e2c3-4645-8550-b5e9067dc129 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.890612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ea2f3f84-2769-4211-9668-59166d9e2664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:40.900654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1201/2405] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:40.901377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcd318-e2c3-4645-8550-b5e9067dc129 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.907218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f3f84-2769-4211-9668-59166d9e2664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.908716 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f3f84-2769-4211-9668-59166d9e2664 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.913861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcd318-e2c3-4645-8550-b5e9067dc129 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.921839 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d811ad-723b-4f22-876a-16853a1c9aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.922706 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d811ad-723b-4f22-876a-16853a1c9aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.922994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d811ad-723b-4f22-876a-16853a1c9aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.923308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d811ad-723b-4f22-876a-16853a1c9aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.924062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d811ad-723b-4f22-876a-16853a1c9aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.925746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1205/2406] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:40.927011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f3f84-2769-4211-9668-59166d9e2664 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.928939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d811ad-723b-4f22-876a-16853a1c9aa1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.946254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f3f84-2769-4211-9668-59166d9e2664 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.954498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109c2b7-369c-4201-9171-a034339798a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:40.955950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109c2b7-369c-4201-9171-a034339798a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.957715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109c2b7-369c-4201-9171-a034339798a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.958211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109c2b7-369c-4201-9171-a034339798a0 admin admin] PATH_INFO: `/v3/projects/82809e43dbd0467b9ef652c2a14efdb2/users/abb2ffa72c6e4a21a0fe6e25c8ed9255/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:40.960806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1202/2407] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:40 2022] POST /identity/v3/users => generated 288 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:40.961358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109c2b7-369c-4201-9171-a034339798a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82809e43dbd0467b9ef652c2a14efdb2, user_id=abb2ffa72c6e4a21a0fe6e25c8ed9255, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:40.965350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109c2b7-369c-4201-9171-a034339798a0 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:40.968607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d811ad-723b-4f22-876a-16853a1c9aa1 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:40.981551 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d811ad-723b-4f22-876a-16853a1c9aa1 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:40.986108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1206/2408] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:40 2022] PUT /identity/v3/projects/82809e43dbd0467b9ef652c2a14efdb2/users/abb2ffa72c6e4a21a0fe6e25c8ed9255/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:40.998764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dcb43-3df9-4dbf-af9b-02cf64474e59 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:40.999063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dcb43-3df9-4dbf-af9b-02cf64474e59 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:40.999346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dcb43-3df9-4dbf-af9b-02cf64474e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:41.047092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-689dcb43-3df9-4dbf-af9b-02cf64474e59 None None] MFA Rules not processed for user `abb2ffa72c6e4a21a0fe6e25c8ed9255`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:41.048583 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-689dcb43-3df9-4dbf-af9b-02cf64474e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:41.088231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd13de6-1b92-4372-8762-2ebf569f0672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:41.088923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13de6-1b92-4372-8762-2ebf569f0672 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:41.089253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13de6-1b92-4372-8762-2ebf569f0672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:41.089536 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13de6-1b92-4372-8762-2ebf569f0672 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:41.090422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd13de6-1b92-4372-8762-2ebf569f0672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:41.092652 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd13de6-1b92-4372-8762-2ebf569f0672 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:41.115384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1203/2409] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:41.120979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd13de6-1b92-4372-8762-2ebf569f0672 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:41.156101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd13de6-1b92-4372-8762-2ebf569f0672 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:41.165135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9146b2-c853-4ae4-8994-c6ee1bfe31d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:41.166230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9146b2-c853-4ae4-8994-c6ee1bfe31d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:41.166560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9146b2-c853-4ae4-8994-c6ee1bfe31d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:41.166917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9146b2-c853-4ae4-8994-c6ee1bfe31d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:41.167900 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9146b2-c853-4ae4-8994-c6ee1bfe31d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:41.171624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9146b2-c853-4ae4-8994-c6ee1bfe31d3 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:41.183204 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1207/2410] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:41.189743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1204/2411] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:41.196565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9146b2-c853-4ae4-8994-c6ee1bfe31d3 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:41.197843 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dcb43-3df9-4dbf-af9b-02cf64474e59 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:41.198434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9f9146b2-c853-4ae4-8994-c6ee1bfe31d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:41.211137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dcb43-3df9-4dbf-af9b-02cf64474e59 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:41.217296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb11fe-3b25-4552-972f-0274bb346e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:41.219006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb11fe-3b25-4552-972f-0274bb346e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:41.219006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb11fe-3b25-4552-972f-0274bb346e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:41.219006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb11fe-3b25-4552-972f-0274bb346e35 admin admin] PATH_INFO: `/v3/projects/fbc2098a68a749e08cee51253252e8b2/users/f260f6d7715946c7abc55ee8c069fa02/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:41.239282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb11fe-3b25-4552-972f-0274bb346e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc2098a68a749e08cee51253252e8b2, user_id=f260f6d7715946c7abc55ee8c069fa02, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:41.242731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb11fe-3b25-4552-972f-0274bb346e35 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:41.268067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1208/2412] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:41 2022] PUT /identity/v3/projects/fbc2098a68a749e08cee51253252e8b2/users/f260f6d7715946c7abc55ee8c069fa02/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:41.282922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd5010-0d59-4fca-85c4-25207f9ccad8 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:41.283391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd5010-0d59-4fca-85c4-25207f9ccad8 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:41.284097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd5010-0d59-4fca-85c4-25207f9ccad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:41.301739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9146b2-c853-4ae4-8994-c6ee1bfe31d3 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:41.323914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-46dd5010-0d59-4fca-85c4-25207f9ccad8 None None] MFA Rules not processed for user `f260f6d7715946c7abc55ee8c069fa02`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:41.325232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-46dd5010-0d59-4fca-85c4-25207f9ccad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:41.394065 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c94a-e873-4044-9f8e-f01bb3c3abb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:41.395549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c94a-e873-4044-9f8e-f01bb3c3abb4 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:41.396004 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c94a-e873-4044-9f8e-f01bb3c3abb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:41.396575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c94a-e873-4044-9f8e-f01bb3c3abb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:41.437717 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1209/2413] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:41.442164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd5010-0d59-4fca-85c4-25207f9ccad8 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:41.502581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c94a-e873-4044-9f8e-f01bb3c3abb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:41.504765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c94a-e873-4044-9f8e-f01bb3c3abb4 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:41.524281 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1205/2414] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:41.561005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd5010-0d59-4fca-85c4-25207f9ccad8 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:41.562007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c94a-e873-4044-9f8e-f01bb3c3abb4 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:41.567229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-33f2c94a-e873-4044-9f8e-f01bb3c3abb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:41.571780 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869594b4-d88f-4401-93e6-ad003e850441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:41.572496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869594b4-d88f-4401-93e6-ad003e850441 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:41.572787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869594b4-d88f-4401-93e6-ad003e850441 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:41.573408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869594b4-d88f-4401-93e6-ad003e850441 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:41.574185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869594b4-d88f-4401-93e6-ad003e850441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:41.576362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869594b4-d88f-4401-93e6-ad003e850441 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:41.631048 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1210/2415] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:41 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:41.632833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869594b4-d88f-4401-93e6-ad003e850441 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:41.636566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-869594b4-d88f-4401-93e6-ad003e850441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:41.694127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c94a-e873-4044-9f8e-f01bb3c3abb4 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:41.770937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869594b4-d88f-4401-93e6-ad003e850441 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:41.776276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6942d-a57d-458d-909b-d4e7bd9eb40c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443fd569cd1b4f6db86d575ed669e26a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:41.777527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:41.778216 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6942d-a57d-458d-909b-d4e7bd9eb40c service placement] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:41.778626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6942d-a57d-458d-909b-d4e7bd9eb40c service placement] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:41.780165 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6942d-a57d-458d-909b-d4e7bd9eb40c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:41.780303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:41.780303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:41.780303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] PATH_INFO: `/v3/projects/9493713ede544b85b5440cfd2caeeb78` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:41.781291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9493713ede544b85b5440cfd2caeeb78)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:41.782379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-73d6942d-a57d-458d-909b-d4e7bd9eb40c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:41.783417 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:41.797339 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6942d-a57d-458d-909b-d4e7bd9eb40c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:41.799054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6942d-a57d-458d-909b-d4e7bd9eb40c service placement] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:41.820801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1206/2416] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:41.821763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6942d-a57d-458d-909b-d4e7bd9eb40c service placement] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:41.848575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6942d-a57d-458d-909b-d4e7bd9eb40c service placement] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:41.854945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9493713ede544b85b5440cfd2caeeb78', 'request_id': 'req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:41.875377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9493713ede544b85b5440cfd2caeeb78', 'request_id': 'req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:41.889961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9493713ede544b85b5440cfd2caeeb78', 'request_id': 'req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:41.925796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] The token cache is being invalidate because project 9493713ede544b85b5440cfd2caeeb78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:41.926646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:41.927359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:41.942336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1211/2417] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:41 2022] DELETE /identity/v3/projects/9493713ede544b85b5440cfd2caeeb78 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:41.948273 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:41.955380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:41.956240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e81681-81fb-4f19-aeee-04d9c7c56a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:41.957797 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e81681-81fb-4f19-aeee-04d9c7c56a30 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:41.958285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e81681-81fb-4f19-aeee-04d9c7c56a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:41.958624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e81681-81fb-4f19-aeee-04d9c7c56a30 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:41.959597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e81681-81fb-4f19-aeee-04d9c7c56a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:41.963465 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e81681-81fb-4f19-aeee-04d9c7c56a30 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:41.988134 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bfbd5-07b1-4a2b-a084-a0f5a9110cf3 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:41.996105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1207/2418] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:41 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:41.997938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849ad5b-a696-47d1-9296-be52ff868c78 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:41.997938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849ad5b-a696-47d1-9296-be52ff868c78 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:41.998315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849ad5b-a696-47d1-9296-be52ff868c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.001924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:42.003096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.003469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.003827 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] PATH_INFO: `/v3/users/99ea78bcfb6c42c69df3a98e29b4aff5` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.005793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99ea78bcfb6c42c69df3a98e29b4aff5)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:42.007810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:42.036101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8849ad5b-a696-47d1-9296-be52ff868c78 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:42.042458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8849ad5b-a696-47d1-9296-be52ff868c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:42.066491 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1208/2419] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:42.066491 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849ad5b-a696-47d1-9296-be52ff868c78 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:42.066491 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8849ad5b-a696-47d1-9296-be52ff868c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:42.075225 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849ad5b-a696-47d1-9296-be52ff868c78 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:42.083495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf3cbb-5b1b-491a-b51f-6e19625792e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:42.084365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3cbb-5b1b-491a-b51f-6e19625792e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.084635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3cbb-5b1b-491a-b51f-6e19625792e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.084909 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf3cbb-5b1b-491a-b51f-6e19625792e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.085718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf3cbb-5b1b-491a-b51f-6e19625792e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:42.087499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf3cbb-5b1b-491a-b51f-6e19625792e6 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:42.100327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99ea78bcfb6c42c69df3a98e29b4aff5'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:42.109771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1209/2420] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:42.112731 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580635ff-44ae-4a31-9936-adb07051e1cf None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.114871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580635ff-44ae-4a31-9936-adb07051e1cf None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.115173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580635ff-44ae-4a31-9936-adb07051e1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.120412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99ea78bcfb6c42c69df3a98e29b4aff5'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:42.121490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99ea78bcfb6c42c69df3a98e29b4aff5'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:42.122686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99ea78bcfb6c42c69df3a98e29b4aff5'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:42.136671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99ea78bcfb6c42c69df3a98e29b4aff5'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:42.141205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-580635ff-44ae-4a31-9936-adb07051e1cf None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:42.142783 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-580635ff-44ae-4a31-9936-adb07051e1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:42.158607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1210/2421] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:42.158607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580635ff-44ae-4a31-9936-adb07051e1cf None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:42.158607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-580635ff-44ae-4a31-9936-adb07051e1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:42.162439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1212/2422] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:41 2022] DELETE /identity/v3/users/99ea78bcfb6c42c69df3a98e29b4aff5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:42.165018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:42.174065 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580635ff-44ae-4a31-9936-adb07051e1cf None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:42.283860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b031783-959c-456f-ad52-f794df74748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:42.284309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b031783-959c-456f-ad52-f794df74748f admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.285304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b031783-959c-456f-ad52-f794df74748f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.285642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b031783-959c-456f-ad52-f794df74748f admin admin] PATH_INFO: `/v3/projects/5779a75c29324b0a9320c624a5fd3ebb/users/4d345545b0ba4371b7c1d39b511f1539/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.304021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b031783-959c-456f-ad52-f794df74748f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5779a75c29324b0a9320c624a5fd3ebb, user_id=4d345545b0ba4371b7c1d39b511f1539, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:42.307007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b031783-959c-456f-ad52-f794df74748f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:42.326967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1211/2423] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:42 2022] PUT /identity/v3/projects/5779a75c29324b0a9320c624a5fd3ebb/users/4d345545b0ba4371b7c1d39b511f1539/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:42.330749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e55a6-5d2d-4bb4-bf08-ed1756eb8394 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.332825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e55a6-5d2d-4bb4-bf08-ed1756eb8394 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.333385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e55a6-5d2d-4bb4-bf08-ed1756eb8394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.342564 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1868f-1d74-4976-b134-81f86838978e admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:42.356612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a84e55a6-5d2d-4bb4-bf08-ed1756eb8394 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:42.358112 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a84e55a6-5d2d-4bb4-bf08-ed1756eb8394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:42.444790 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1212/2424] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:42.448697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e55a6-5d2d-4bb4-bf08-ed1756eb8394 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:42.461111 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e55a6-5d2d-4bb4-bf08-ed1756eb8394 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:42.467999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699c09e-36e8-4298-9edb-ce380b16d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:42.468483 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef325-5d1d-499e-a55e-fad57b45db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:42.468708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c09e-36e8-4298-9edb-ce380b16d836 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.468998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c09e-36e8-4298-9edb-ce380b16d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.469199 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c09e-36e8-4298-9edb-ce380b16d836 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.469354 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef325-5d1d-499e-a55e-fad57b45db02 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.469697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef325-5d1d-499e-a55e-fad57b45db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.469995 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef325-5d1d-499e-a55e-fad57b45db02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.470134 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699c09e-36e8-4298-9edb-ce380b16d836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:42.470376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699c09e-36e8-4298-9edb-ce380b16d836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:42.471055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cef325-5d1d-499e-a55e-fad57b45db02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:42.473237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699c09e-36e8-4298-9edb-ce380b16d836 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:42.473902 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cef325-5d1d-499e-a55e-fad57b45db02 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:42.489430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1213/2425] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:42.493282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1213/2426] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:42.493446 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699c09e-36e8-4298-9edb-ce380b16d836 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:42.498345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b699c09e-36e8-4298-9edb-ce380b16d836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:42.498986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef325-5d1d-499e-a55e-fad57b45db02 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:42.523373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef325-5d1d-499e-a55e-fad57b45db02 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:42.545743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879aecb9-13e9-4d9c-b70f-171b81b4cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:42.546342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aecb9-13e9-4d9c-b70f-171b81b4cf28 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.546613 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aecb9-13e9-4d9c-b70f-171b81b4cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.546889 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aecb9-13e9-4d9c-b70f-171b81b4cf28 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.547938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879aecb9-13e9-4d9c-b70f-171b81b4cf28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:42.549804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879aecb9-13e9-4d9c-b70f-171b81b4cf28 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:42.593286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699c09e-36e8-4298-9edb-ce380b16d836 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:42.595969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1214/2427] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:42 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:42.596413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879aecb9-13e9-4d9c-b70f-171b81b4cf28 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:42.668988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6af598-f2fe-4dad-9597-639f541905b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:42.669574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af598-f2fe-4dad-9597-639f541905b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.669850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af598-f2fe-4dad-9597-639f541905b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.670124 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af598-f2fe-4dad-9597-639f541905b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.742783 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879aecb9-13e9-4d9c-b70f-171b81b4cf28 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:42.752137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631539f-d951-4a20-8774-6e394d1914ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:42.767931 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631539f-d951-4a20-8774-6e394d1914ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.768455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631539f-d951-4a20-8774-6e394d1914ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.769438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631539f-d951-4a20-8774-6e394d1914ab admin admin] PATH_INFO: `/v3/projects/5779a75c29324b0a9320c624a5fd3ebb/users/4d345545b0ba4371b7c1d39b511f1539/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.772066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631539f-d951-4a20-8774-6e394d1914ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5779a75c29324b0a9320c624a5fd3ebb, user_id=4d345545b0ba4371b7c1d39b511f1539, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:42.775115 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631539f-d951-4a20-8774-6e394d1914ab admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:42.795152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1215/2428] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:42 2022] PUT /identity/v3/projects/5779a75c29324b0a9320c624a5fd3ebb/users/4d345545b0ba4371b7c1d39b511f1539/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:42.796257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631539f-d951-4a20-8774-6e394d1914ab admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:42.814887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6af598-f2fe-4dad-9597-639f541905b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:42.816915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6af598-f2fe-4dad-9597-639f541905b1 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:42.832109 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1214/2429] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:42.834015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a55c-5983-4cda-ad2c-3108e180051a None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.834304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a55c-5983-4cda-ad2c-3108e180051a None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.834581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a55c-5983-4cda-ad2c-3108e180051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.872611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1c23a55c-5983-4cda-ad2c-3108e180051a None None] MFA Rules not processed for user `4d345545b0ba4371b7c1d39b511f1539`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:42.874471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1c23a55c-5983-4cda-ad2c-3108e180051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:42.890812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631539f-d951-4a20-8774-6e394d1914ab admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:42.897581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463a68f-ed99-4d9a-bae6-0cb30c7aead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:42.898277 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463a68f-ed99-4d9a-bae6-0cb30c7aead1 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.899210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463a68f-ed99-4d9a-bae6-0cb30c7aead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.899498 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463a68f-ed99-4d9a-bae6-0cb30c7aead1 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.900408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463a68f-ed99-4d9a-bae6-0cb30c7aead1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:42.903472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463a68f-ed99-4d9a-bae6-0cb30c7aead1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:42.945166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1216/2430] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:42 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:42.949674 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463a68f-ed99-4d9a-bae6-0cb30c7aead1 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:42.967792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463a68f-ed99-4d9a-bae6-0cb30c7aead1 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:42.974391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82007764-5e6f-4e9e-b4bd-4155ed3c8994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:42.975243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007764-5e6f-4e9e-b4bd-4155ed3c8994 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:42.975529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007764-5e6f-4e9e-b4bd-4155ed3c8994 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:42.975854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007764-5e6f-4e9e-b4bd-4155ed3c8994 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:42.976603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82007764-5e6f-4e9e-b4bd-4155ed3c8994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:42.978798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82007764-5e6f-4e9e-b4bd-4155ed3c8994 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:42.991559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1215/2431] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:42.998542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1217/2432] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:43.006232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23a55c-5983-4cda-ad2c-3108e180051a None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:43.008958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82007764-5e6f-4e9e-b4bd-4155ed3c8994 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:43.011248 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-82007764-5e6f-4e9e-b4bd-4155ed3c8994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:43.032440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23a55c-5983-4cda-ad2c-3108e180051a None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:43.042405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219d60e-5a2d-412a-854a-9a6da879fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:43.043370 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219d60e-5a2d-412a-854a-9a6da879fa76 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:43.043899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219d60e-5a2d-412a-854a-9a6da879fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:43.044364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219d60e-5a2d-412a-854a-9a6da879fa76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:43.045298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219d60e-5a2d-412a-854a-9a6da879fa76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:43.049154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219d60e-5a2d-412a-854a-9a6da879fa76 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:43.071527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1216/2433] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:43.073605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219d60e-5a2d-412a-854a-9a6da879fa76 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:43.091833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219d60e-5a2d-412a-854a-9a6da879fa76 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:43.108914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd606c2-df0f-4d6d-a5a7-deff5a9de129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:43.110437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd606c2-df0f-4d6d-a5a7-deff5a9de129 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:43.110914 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd606c2-df0f-4d6d-a5a7-deff5a9de129 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:43.111377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd606c2-df0f-4d6d-a5a7-deff5a9de129 admin admin] PATH_INFO: `/v3/projects/0f27946ce2a44f1caf82a59ba9d8e631/users/3ca644f86def4a18ac6401db707aead5/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:43.114074 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82007764-5e6f-4e9e-b4bd-4155ed3c8994 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:43.123638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d007b-50e4-4be0-98f5-a530f2583d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:43.124705 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d007b-50e4-4be0-98f5-a530f2583d1d service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:43.125098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d007b-50e4-4be0-98f5-a530f2583d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:43.125469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d007b-50e4-4be0-98f5-a530f2583d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:43.129232 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-978d007b-50e4-4be0-98f5-a530f2583d1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:43.138963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd606c2-df0f-4d6d-a5a7-deff5a9de129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f27946ce2a44f1caf82a59ba9d8e631, user_id=3ca644f86def4a18ac6401db707aead5, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:43.144568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd606c2-df0f-4d6d-a5a7-deff5a9de129 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:43.164692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1217/2434] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:43 2022] PUT /identity/v3/projects/0f27946ce2a44f1caf82a59ba9d8e631/users/3ca644f86def4a18ac6401db707aead5/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:43.176019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9c937-59e0-461d-93ad-14472fb81cd5 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:43.177136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9c937-59e0-461d-93ad-14472fb81cd5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:43.177598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9c937-59e0-461d-93ad-14472fb81cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:43.219850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-88d9c937-59e0-461d-93ad-14472fb81cd5 None None] MFA Rules not processed for user `3ca644f86def4a18ac6401db707aead5`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:43.222755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-88d9c937-59e0-461d-93ad-14472fb81cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:43.298356 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d007b-50e4-4be0-98f5-a530f2583d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:43.304825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d007b-50e4-4be0-98f5-a530f2583d1d service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:43.380534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1218/2435] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:56:43.430563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1218/2436] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:43.434733 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d007b-50e4-4be0-98f5-a530f2583d1d service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:43.451297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d007b-50e4-4be0-98f5-a530f2583d1d service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:43.665496 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9c62b-29d2-49a7-9cdc-3ea2e63a3b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:43.667801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c62b-29d2-49a7-9cdc-3ea2e63a3b4a admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:43.668000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c62b-29d2-49a7-9cdc-3ea2e63a3b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:43.668203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c62b-29d2-49a7-9cdc-3ea2e63a3b4a admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:43.673934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9c62b-29d2-49a7-9cdc-3ea2e63a3b4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:43.683788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9c62b-29d2-49a7-9cdc-3ea2e63a3b4a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:43.791123 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1219/2437] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:43 2022] POST /identity/v3/projects => generated 383 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:43.792418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9c937-59e0-461d-93ad-14472fb81cd5 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:43.808964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9c937-59e0-461d-93ad-14472fb81cd5 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:43.967491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f639d4-f277-495d-8da3-ab66fca4b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:43.968561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f639d4-f277-495d-8da3-ab66fca4b45a admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:43.969098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f639d4-f277-495d-8da3-ab66fca4b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:43.976642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f639d4-f277-495d-8da3-ab66fca4b45a admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:43.977460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f639d4-f277-495d-8da3-ab66fca4b45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:43.983416 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f639d4-f277-495d-8da3-ab66fca4b45a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:44.097095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9c62b-29d2-49a7-9cdc-3ea2e63a3b4a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:44.117880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9c62b-29d2-49a7-9cdc-3ea2e63a3b4a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:44.118563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1219/2438] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:43 2022] POST /identity/v3/users => generated 298 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:44.135899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5fd85-119c-4651-87c0-ab1e287ca477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:44.136782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5fd85-119c-4651-87c0-ab1e287ca477 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:44.137186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5fd85-119c-4651-87c0-ab1e287ca477 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:44.137567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5fd85-119c-4651-87c0-ab1e287ca477 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:44.138466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5fd85-119c-4651-87c0-ab1e287ca477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:44.140473 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5fd85-119c-4651-87c0-ab1e287ca477 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:44.161458 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1220/2439] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:44.165707 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f639d4-f277-495d-8da3-ab66fca4b45a admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:44.186687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f639d4-f277-495d-8da3-ab66fca4b45a admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:44.216581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eea31e-c5b6-4dcc-9238-590942bbe73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:44.234013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eea31e-c5b6-4dcc-9238-590942bbe73e admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:44.235692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eea31e-c5b6-4dcc-9238-590942bbe73e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:44.237294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eea31e-c5b6-4dcc-9238-590942bbe73e admin admin] PATH_INFO: `/v3/projects/f611c1bf33d947aeb5715cfd4073f7db/users/4bd6e8322e044f83b19abab3f9ff25c3/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:44.299472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eea31e-c5b6-4dcc-9238-590942bbe73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f611c1bf33d947aeb5715cfd4073f7db, user_id=4bd6e8322e044f83b19abab3f9ff25c3, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:44.308765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eea31e-c5b6-4dcc-9238-590942bbe73e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:44.341355 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5fd85-119c-4651-87c0-ab1e287ca477 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:44.342133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1220/2440] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:44 2022] PUT /identity/v3/projects/f611c1bf33d947aeb5715cfd4073f7db/users/4bd6e8322e044f83b19abab3f9ff25c3/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:44.358712 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5fd85-119c-4651-87c0-ab1e287ca477 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:44.474315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18f0f3-d225-4fcc-b33c-4c81040e0f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:44.475849 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18f0f3-d225-4fcc-b33c-4c81040e0f8d admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:44.478460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18f0f3-d225-4fcc-b33c-4c81040e0f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:44.478924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18f0f3-d225-4fcc-b33c-4c81040e0f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:44.479883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18f0f3-d225-4fcc-b33c-4c81040e0f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:44.481545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18f0f3-d225-4fcc-b33c-4c81040e0f8d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:44.505664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eea31e-c5b6-4dcc-9238-590942bbe73e admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:44.514940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1221/2441] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:44.519750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eea31e-c5b6-4dcc-9238-590942bbe73e admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:44.526185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf0d87-9a3f-4bb8-97a2-c895d22f7e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:44.528245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf0d87-9a3f-4bb8-97a2-c895d22f7e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:44.528832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf0d87-9a3f-4bb8-97a2-c895d22f7e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:44.529455 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf0d87-9a3f-4bb8-97a2-c895d22f7e67 admin admin] PATH_INFO: `/v3/projects/f611c1bf33d947aeb5715cfd4073f7db/users/4bd6e8322e044f83b19abab3f9ff25c3/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:44.535355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf0d87-9a3f-4bb8-97a2-c895d22f7e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f611c1bf33d947aeb5715cfd4073f7db, user_id=4bd6e8322e044f83b19abab3f9ff25c3, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:44.542780 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf0d87-9a3f-4bb8-97a2-c895d22f7e67 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:44.551008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18f0f3-d225-4fcc-b33c-4c81040e0f8d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:44.553213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-ce18f0f3-d225-4fcc-b33c-4c81040e0f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:44.574257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1221/2442] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:44 2022] PUT /identity/v3/projects/f611c1bf33d947aeb5715cfd4073f7db/users/4bd6e8322e044f83b19abab3f9ff25c3/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:44.584464 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adebb69-15b3-4819-b4a0-e0c985909ae2 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:44.584991 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adebb69-15b3-4819-b4a0-e0c985909ae2 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:44.585318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adebb69-15b3-4819-b4a0-e0c985909ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:44.605651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18f0f3-d225-4fcc-b33c-4c81040e0f8d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:44.638154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-7adebb69-15b3-4819-b4a0-e0c985909ae2 None None] MFA Rules not processed for user `4bd6e8322e044f83b19abab3f9ff25c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:44.639447 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7adebb69-15b3-4819-b4a0-e0c985909ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:44.687782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:44.689105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:44.689373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:44.689872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] PATH_INFO: `/v3/projects/24dc59ab57ae456ea079ed1de15f7323` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:44.692304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24dc59ab57ae456ea079ed1de15f7323)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:44.694368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:44.752353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1222/2443] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:44.764719 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adebb69-15b3-4819-b4a0-e0c985909ae2 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:44.773931 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24dc59ab57ae456ea079ed1de15f7323', 'request_id': 'req-43a4701d-60af-481d-81d4-7d696dba18b9'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:44.782351 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24dc59ab57ae456ea079ed1de15f7323', 'request_id': 'req-43a4701d-60af-481d-81d4-7d696dba18b9'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:44.792827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24dc59ab57ae456ea079ed1de15f7323', 'request_id': 'req-43a4701d-60af-481d-81d4-7d696dba18b9'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:44.810957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] The token cache is being invalidate because project 24dc59ab57ae456ea079ed1de15f7323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:44.811280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:44.812003 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:44.819438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1222/2444] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:44 2022] DELETE /identity/v3/projects/24dc59ab57ae456ea079ed1de15f7323 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:44.820528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:44.823377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:44.867443 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adebb69-15b3-4819-b4a0-e0c985909ae2 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:44.925587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4701d-60af-481d-81d4-7d696dba18b9 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:44.930890 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:44.931983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:44.932683 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:44.933062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] PATH_INFO: `/v3/users/abb2ffa72c6e4a21a0fe6e25c8ed9255` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:44.935015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb2ffa72c6e4a21a0fe6e25c8ed9255)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:44.937957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:44.990743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c67ba0-9ffa-4902-b53a-c45b60178319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:44.992050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c67ba0-9ffa-4902-b53a-c45b60178319 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:44.992549 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c67ba0-9ffa-4902-b53a-c45b60178319 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:44.993196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c67ba0-9ffa-4902-b53a-c45b60178319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:44.995806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-28c67ba0-9ffa-4902-b53a-c45b60178319 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:45.027960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb2ffa72c6e4a21a0fe6e25c8ed9255'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.048530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb2ffa72c6e4a21a0fe6e25c8ed9255'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.049374 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb2ffa72c6e4a21a0fe6e25c8ed9255'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.070001 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb2ffa72c6e4a21a0fe6e25c8ed9255'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.082061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb2ffa72c6e4a21a0fe6e25c8ed9255'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.094048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1223/2445] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:44 2022] DELETE /identity/v3/users/abb2ffa72c6e4a21a0fe6e25c8ed9255 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:45.110102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c67ba0-9ffa-4902-b53a-c45b60178319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:45.111672 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c67ba0-9ffa-4902-b53a-c45b60178319 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:45.136133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1223/2446] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:56:45.217234 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:45.218752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:45.298856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519bdb3-8561-4250-bbf9-d01cf7b0efc8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:45.309904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:45.310859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:45.311166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:45.311413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] PATH_INFO: `/v3/users/3ca644f86def4a18ac6401db707aead5` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:45.312746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca644f86def4a18ac6401db707aead5)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:45.315147 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:45.413532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca644f86def4a18ac6401db707aead5'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.429885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca644f86def4a18ac6401db707aead5'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.431381 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca644f86def4a18ac6401db707aead5'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.474586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca644f86def4a18ac6401db707aead5'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.490117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca644f86def4a18ac6401db707aead5'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.499575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1224/2447] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:45 2022] DELETE /identity/v3/users/3ca644f86def4a18ac6401db707aead5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:45.506052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167241b-353d-414f-86f5-c48024a7bc44 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:45.506592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167241b-353d-414f-86f5-c48024a7bc44 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:45.506592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167241b-353d-414f-86f5-c48024a7bc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:45.534812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-3167241b-353d-414f-86f5-c48024a7bc44 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:45.534812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3167241b-353d-414f-86f5-c48024a7bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:45.631274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1224/2448] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:45.645712 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:45.647545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:45.658332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167241b-353d-414f-86f5-c48024a7bc44 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:45.665311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3167241b-353d-414f-86f5-c48024a7bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:45.734192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167241b-353d-414f-86f5-c48024a7bc44 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:45.740799 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:45.741910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:45.742319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:45.742681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] PATH_INFO: `/v3/projects/82809e43dbd0467b9ef652c2a14efdb2` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:45.744649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82809e43dbd0467b9ef652c2a14efdb2)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:45.746863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:45.804654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9f099-724f-441d-90c7-a70a40630ae7 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:45.811199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff175ee-daaf-4be7-90e0-d79a8280eb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:45.811931 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff175ee-daaf-4be7-90e0-d79a8280eb53 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:45.812241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff175ee-daaf-4be7-90e0-d79a8280eb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:45.812523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff175ee-daaf-4be7-90e0-d79a8280eb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:45.843395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff175ee-daaf-4be7-90e0-d79a8280eb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:45.844866 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff175ee-daaf-4be7-90e0-d79a8280eb53 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:45.871362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82809e43dbd0467b9ef652c2a14efdb2', 'request_id': 'req-72cd901c-c0b9-4cd4-89b6-d04860d34147'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.878904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1225/2449] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:56:45.880863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82809e43dbd0467b9ef652c2a14efdb2', 'request_id': 'req-72cd901c-c0b9-4cd4-89b6-d04860d34147'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.906851 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82809e43dbd0467b9ef652c2a14efdb2', 'request_id': 'req-72cd901c-c0b9-4cd4-89b6-d04860d34147'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.923697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] The token cache is being invalidate because project 82809e43dbd0467b9ef652c2a14efdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:45.924671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.926058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-72cd901c-c0b9-4cd4-89b6-d04860d34147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:45.933226 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1225/2450] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:45 2022] DELETE /identity/v3/projects/82809e43dbd0467b9ef652c2a14efdb2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:45.937938 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e4052-c18c-4ba6-a440-336106859cbe None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:45.938309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e4052-c18c-4ba6-a440-336106859cbe None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:45.939142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e4052-c18c-4ba6-a440-336106859cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:45.969732 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-002e4052-c18c-4ba6-a440-336106859cbe None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:45.971041 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-002e4052-c18c-4ba6-a440-336106859cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:46.078094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1226/2451] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:46.079964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2e9e-a06c-43fe-9d53-55c1a1771b60 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.080273 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2e9e-a06c-43fe-9d53-55c1a1771b60 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.080542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2e9e-a06c-43fe-9d53-55c1a1771b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.113821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-bcfd2e9e-a06c-43fe-9d53-55c1a1771b60 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:46.115569 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-bcfd2e9e-a06c-43fe-9d53-55c1a1771b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:46.137260 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1226/2452] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:46.146995 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e4052-c18c-4ba6-a440-336106859cbe None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:46.166552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e4052-c18c-4ba6-a440-336106859cbe None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:46.181786 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485badf-c5b5-48f1-9e57-03cabe086ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:46.182609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485badf-c5b5-48f1-9e57-03cabe086ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.182988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485badf-c5b5-48f1-9e57-03cabe086ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.183360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485badf-c5b5-48f1-9e57-03cabe086ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.184491 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485badf-c5b5-48f1-9e57-03cabe086ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:46.184897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485badf-c5b5-48f1-9e57-03cabe086ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:46.187853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485badf-c5b5-48f1-9e57-03cabe086ae5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:46.211976 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd2e9e-a06c-43fe-9d53-55c1a1771b60 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:46.219244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1227/2453] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:46.226164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd2e9e-a06c-43fe-9d53-55c1a1771b60 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:46.233342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c430f3-fe93-435c-9db2-dd2ab8aa86f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:46.234225 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c430f3-fe93-435c-9db2-dd2ab8aa86f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.234657 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c430f3-fe93-435c-9db2-dd2ab8aa86f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.235029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c430f3-fe93-435c-9db2-dd2ab8aa86f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.236153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c430f3-fe93-435c-9db2-dd2ab8aa86f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:46.238460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c430f3-fe93-435c-9db2-dd2ab8aa86f7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:46.294488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1227/2454] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:46 2022] POST /identity/v3/projects => generated 401 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:46.302219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485badf-c5b5-48f1-9e57-03cabe086ae5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:46.335308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485badf-c5b5-48f1-9e57-03cabe086ae5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:46.437453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02381b48-80a1-46a9-a072-ce1402a7839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:46.439329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381b48-80a1-46a9-a072-ce1402a7839d admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.439964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381b48-80a1-46a9-a072-ce1402a7839d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.441154 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381b48-80a1-46a9-a072-ce1402a7839d admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.442456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02381b48-80a1-46a9-a072-ce1402a7839d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:46.445139 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02381b48-80a1-46a9-a072-ce1402a7839d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:46.476732 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1228/2455] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:46 2022] POST /identity/v3/users => generated 301 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:46.480559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c430f3-fe93-435c-9db2-dd2ab8aa86f7 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:46.493108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c430f3-fe93-435c-9db2-dd2ab8aa86f7 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:46.512493 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03315fef-3e1f-4210-91f0-ae2bfb3ebc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:46.516501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315fef-3e1f-4210-91f0-ae2bfb3ebc2d admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.517029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315fef-3e1f-4210-91f0-ae2bfb3ebc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.517317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315fef-3e1f-4210-91f0-ae2bfb3ebc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.518153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03315fef-3e1f-4210-91f0-ae2bfb3ebc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:46.523878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03315fef-3e1f-4210-91f0-ae2bfb3ebc2d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:46.545246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1228/2456] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:46.551298 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02381b48-80a1-46a9-a072-ce1402a7839d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:46.562301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02381b48-80a1-46a9-a072-ce1402a7839d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:46.568660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0393a52-9fd1-4bb5-a78a-5c142314db2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:46.569526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0393a52-9fd1-4bb5-a78a-5c142314db2d admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.570051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0393a52-9fd1-4bb5-a78a-5c142314db2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.570435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0393a52-9fd1-4bb5-a78a-5c142314db2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.571287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0393a52-9fd1-4bb5-a78a-5c142314db2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:46.573188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0393a52-9fd1-4bb5-a78a-5c142314db2d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:46.588645 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1229/2457] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:46.590173 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03315fef-3e1f-4210-91f0-ae2bfb3ebc2d admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:46.602465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03315fef-3e1f-4210-91f0-ae2bfb3ebc2d admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:46.608792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6481a9-5702-48fa-b960-e796d82cb170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:46.610218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6481a9-5702-48fa-b960-e796d82cb170 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.610677 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6481a9-5702-48fa-b960-e796d82cb170 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.611118 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6481a9-5702-48fa-b960-e796d82cb170 admin admin] PATH_INFO: `/v3/projects/71c745e694444de7b29f5fccf782fafd/users/0371f46a6bfc4f1d910c8ae7386a794f/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.631681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6481a9-5702-48fa-b960-e796d82cb170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c745e694444de7b29f5fccf782fafd, user_id=0371f46a6bfc4f1d910c8ae7386a794f, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:46.637421 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6481a9-5702-48fa-b960-e796d82cb170 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:46.666544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1229/2458] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:46 2022] PUT /identity/v3/projects/71c745e694444de7b29f5fccf782fafd/users/0371f46a6bfc4f1d910c8ae7386a794f/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:46.676855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59a47e-2e98-4b94-b17a-182ba0061e6c None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.677145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59a47e-2e98-4b94-b17a-182ba0061e6c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.677454 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59a47e-2e98-4b94-b17a-182ba0061e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.733657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-7e59a47e-2e98-4b94-b17a-182ba0061e6c None None] MFA Rules not processed for user `0371f46a6bfc4f1d910c8ae7386a794f`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:46.735024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7e59a47e-2e98-4b94-b17a-182ba0061e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:46.759283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6481a9-5702-48fa-b960-e796d82cb170 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:46.761506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ae6481a9-5702-48fa-b960-e796d82cb170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:46.888243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1230/2459] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:46.888243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59a47e-2e98-4b94-b17a-182ba0061e6c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:46.896426 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7e59a47e-2e98-4b94-b17a-182ba0061e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:46.896721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6481a9-5702-48fa-b960-e796d82cb170 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:46.902233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:46.904123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.904542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.904963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] PATH_INFO: `/v3/users/f260f6d7715946c7abc55ee8c069fa02` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.906425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f260f6d7715946c7abc55ee8c069fa02)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:46.909183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:46.914423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59a47e-2e98-4b94-b17a-182ba0061e6c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:46.921827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:46.922874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:46.923026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:46.928355 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] PATH_INFO: `/v3/projects/0f27946ce2a44f1caf82a59ba9d8e631` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:46.935199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f27946ce2a44f1caf82a59ba9d8e631)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:46.937810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:47.002615 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f260f6d7715946c7abc55ee8c069fa02'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.018668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f27946ce2a44f1caf82a59ba9d8e631', 'request_id': 'req-105b0bc4-6610-4024-b29f-fe093dbc2c16'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.020733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f260f6d7715946c7abc55ee8c069fa02'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.021692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f260f6d7715946c7abc55ee8c069fa02'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.022568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f260f6d7715946c7abc55ee8c069fa02'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.028598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f27946ce2a44f1caf82a59ba9d8e631', 'request_id': 'req-105b0bc4-6610-4024-b29f-fe093dbc2c16'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.039627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f260f6d7715946c7abc55ee8c069fa02'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.043755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f27946ce2a44f1caf82a59ba9d8e631', 'request_id': 'req-105b0bc4-6610-4024-b29f-fe093dbc2c16'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.058615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] The token cache is being invalidate because project 0f27946ce2a44f1caf82a59ba9d8e631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:47.058902 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.060218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.061828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1231/2460] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:46 2022] DELETE /identity/v3/projects/0f27946ce2a44f1caf82a59ba9d8e631 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:47.062582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:47.065687 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:47.066553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1230/2461] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:46 2022] DELETE /identity/v3/users/f260f6d7715946c7abc55ee8c069fa02 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:47.068085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:47.069792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:47.142979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b0bc4-6610-4024-b29f-fe093dbc2c16 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:47.146395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bf834-3a8c-4e37-a930-8b09a4583d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:47.147076 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bf834-3a8c-4e37-a930-8b09a4583d1b admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.147361 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bf834-3a8c-4e37-a930-8b09a4583d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.147638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bf834-3a8c-4e37-a930-8b09a4583d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.148182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f62d2-1783-459c-b169-21039efd8840 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:47.148369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bf834-3a8c-4e37-a930-8b09a4583d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:47.150781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bf834-3a8c-4e37-a930-8b09a4583d1b admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:47.153250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:47.154392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.154682 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.155377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] PATH_INFO: `/v3/users/4bd6e8322e044f83b19abab3f9ff25c3` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.157089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd6e8322e044f83b19abab3f9ff25c3)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:47.159071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:47.186329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1232/2462] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:47 2022] POST /identity/v3/projects => generated 399 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:47.186329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589cd29-5ccc-4c29-9ac3-f13bcdcf5bc0 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.186329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589cd29-5ccc-4c29-9ac3-f13bcdcf5bc0 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.186329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589cd29-5ccc-4c29-9ac3-f13bcdcf5bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.209236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-6589cd29-5ccc-4c29-9ac3-f13bcdcf5bc0 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:47.210472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-6589cd29-5ccc-4c29-9ac3-f13bcdcf5bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:47.220136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd6e8322e044f83b19abab3f9ff25c3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.234362 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd6e8322e044f83b19abab3f9ff25c3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.235221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd6e8322e044f83b19abab3f9ff25c3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.235980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd6e8322e044f83b19abab3f9ff25c3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.244838 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd6e8322e044f83b19abab3f9ff25c3'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:47.258457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1231/2463] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:47 2022] DELETE /identity/v3/users/4bd6e8322e044f83b19abab3f9ff25c3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:47.259821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:47.261357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:47.284045 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1233/2464] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:47.299271 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589cd29-5ccc-4c29-9ac3-f13bcdcf5bc0 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:47.301636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-6589cd29-5ccc-4c29-9ac3-f13bcdcf5bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:47.344012 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1467f-c793-471b-af52-379d660cc7b3 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:47.352115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a696c-2a32-4f19-ba26-477477074501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:47.353081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a696c-2a32-4f19-ba26-477477074501 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.353664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a696c-2a32-4f19-ba26-477477074501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.354431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a696c-2a32-4f19-ba26-477477074501 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.355744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a696c-2a32-4f19-ba26-477477074501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:47.358341 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a696c-2a32-4f19-ba26-477477074501 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:47.385522 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589cd29-5ccc-4c29-9ac3-f13bcdcf5bc0 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:47.396385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1232/2465] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:47 2022] POST /identity/v3/users => generated 306 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:47.401257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a696c-2a32-4f19-ba26-477477074501 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:47.418825 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a696c-2a32-4f19-ba26-477477074501 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:47.427357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5c556-7c4d-4ed0-ba72-0286b87a6d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:47.428264 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c556-7c4d-4ed0-ba72-0286b87a6d40 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.428670 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c556-7c4d-4ed0-ba72-0286b87a6d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.429016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c556-7c4d-4ed0-ba72-0286b87a6d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.429937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c556-7c4d-4ed0-ba72-0286b87a6d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:47.433606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c556-7c4d-4ed0-ba72-0286b87a6d40 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:47.453469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1233/2466] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:47.454496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5c556-7c4d-4ed0-ba72-0286b87a6d40 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:47.463184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05338b1a-8283-47e6-970c-1e784a812f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:47.464033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05338b1a-8283-47e6-970c-1e784a812f32 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.464258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05338b1a-8283-47e6-970c-1e784a812f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.464624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05338b1a-8283-47e6-970c-1e784a812f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.470344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5c556-7c4d-4ed0-ba72-0286b87a6d40 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:47.478029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8976a00-3415-4d97-bab1-c50f02318c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:47.479468 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976a00-3415-4d97-bab1-c50f02318c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.479867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976a00-3415-4d97-bab1-c50f02318c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.480151 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976a00-3415-4d97-bab1-c50f02318c76 admin admin] PATH_INFO: `/v3/projects/4ac0b4dc6dd54229ae241bf65fa5a3cf/users/f8eab97f780a4140bac81ef18a9dabab/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.483330 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05338b1a-8283-47e6-970c-1e784a812f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:47.485101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05338b1a-8283-47e6-970c-1e784a812f32 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:47.498638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1234/2467] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:56:47.499862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8976a00-3415-4d97-bab1-c50f02318c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac0b4dc6dd54229ae241bf65fa5a3cf, user_id=f8eab97f780a4140bac81ef18a9dabab, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:47.502560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8976a00-3415-4d97-bab1-c50f02318c76 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:47.519824 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1234/2468] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:47 2022] PUT /identity/v3/projects/4ac0b4dc6dd54229ae241bf65fa5a3cf/users/f8eab97f780a4140bac81ef18a9dabab/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:47.523614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05338b1a-8283-47e6-970c-1e784a812f32 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:47.535017 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05338b1a-8283-47e6-970c-1e784a812f32 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:47.612642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf9fe6-2da3-4a1c-80c8-27cfa8cbd09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:47.614366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf9fe6-2da3-4a1c-80c8-27cfa8cbd09f admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.614651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf9fe6-2da3-4a1c-80c8-27cfa8cbd09f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.614936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf9fe6-2da3-4a1c-80c8-27cfa8cbd09f admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.615735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf9fe6-2da3-4a1c-80c8-27cfa8cbd09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:47.617508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf9fe6-2da3-4a1c-80c8-27cfa8cbd09f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:47.630774 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1235/2469] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:47.634849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8976a00-3415-4d97-bab1-c50f02318c76 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:47.647894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8976a00-3415-4d97-bab1-c50f02318c76 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:47.653419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bde23-fe49-4473-aac4-ae015261ee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:47.654250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bde23-fe49-4473-aac4-ae015261ee7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.654539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bde23-fe49-4473-aac4-ae015261ee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.654811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bde23-fe49-4473-aac4-ae015261ee7f admin admin] PATH_INFO: `/v3/projects/4ac0b4dc6dd54229ae241bf65fa5a3cf/users/f8eab97f780a4140bac81ef18a9dabab/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.657180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bde23-fe49-4473-aac4-ae015261ee7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac0b4dc6dd54229ae241bf65fa5a3cf, user_id=f8eab97f780a4140bac81ef18a9dabab, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:47.660136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bde23-fe49-4473-aac4-ae015261ee7f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:47.686327 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1235/2470] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:47 2022] PUT /identity/v3/projects/4ac0b4dc6dd54229ae241bf65fa5a3cf/users/f8eab97f780a4140bac81ef18a9dabab/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:47.698910 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1990-8017-4d0d-a97e-f76acb799e75 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.699262 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1990-8017-4d0d-a97e-f76acb799e75 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.699582 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1990-8017-4d0d-a97e-f76acb799e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.736532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-68fc1990-8017-4d0d-a97e-f76acb799e75 None None] MFA Rules not processed for user `f8eab97f780a4140bac81ef18a9dabab`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:47.740152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-68fc1990-8017-4d0d-a97e-f76acb799e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:47.809827 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bde23-fe49-4473-aac4-ae015261ee7f admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:47.813837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9f9bde23-fe49-4473-aac4-ae015261ee7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:47.835492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1236/2471] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:47.835492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc1990-8017-4d0d-a97e-f76acb799e75 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:47.837100 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-68fc1990-8017-4d0d-a97e-f76acb799e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:47.927062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc1990-8017-4d0d-a97e-f76acb799e75 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:47.937606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:47.939119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.939803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.941211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] PATH_INFO: `/v3/projects/f611c1bf33d947aeb5715cfd4073f7db` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.943033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f611c1bf33d947aeb5715cfd4073f7db)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:47.946305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:47.947969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bde23-fe49-4473-aac4-ae015261ee7f admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:47.953598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:47.955025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:47.955317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:47.955656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] PATH_INFO: `/v3/projects/fbc2098a68a749e08cee51253252e8b2` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:47.957717 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc2098a68a749e08cee51253252e8b2)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:47.961012 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:48.037602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc2098a68a749e08cee51253252e8b2', 'request_id': 'req-069a0b44-3069-4e57-8c73-189b8601821b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.044429 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc2098a68a749e08cee51253252e8b2', 'request_id': 'req-069a0b44-3069-4e57-8c73-189b8601821b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.048634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f611c1bf33d947aeb5715cfd4073f7db', 'request_id': 'req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.055428 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc2098a68a749e08cee51253252e8b2', 'request_id': 'req-069a0b44-3069-4e57-8c73-189b8601821b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.058702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f611c1bf33d947aeb5715cfd4073f7db', 'request_id': 'req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.070288 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] The token cache is being invalidate because project fbc2098a68a749e08cee51253252e8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:48.070706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.070901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f611c1bf33d947aeb5715cfd4073f7db', 'request_id': 'req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.071522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.073437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1236/2472] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:47 2022] DELETE /identity/v3/projects/fbc2098a68a749e08cee51253252e8b2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:48.077764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:48.081799 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:48.089224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] The token cache is being invalidate because project f611c1bf33d947aeb5715cfd4073f7db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:48.090188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.092011 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.094427 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1237/2473] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:47 2022] DELETE /identity/v3/projects/f611c1bf33d947aeb5715cfd4073f7db => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:48.095142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:48.096964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:48.176354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a0b44-3069-4e57-8c73-189b8601821b admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:48.199102 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bfacf-53cf-4828-b6f1-333f3a86d2c3 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:48.206982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55256a64-ee8b-4d5a-b294-680142c4fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:48.208468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55256a64-ee8b-4d5a-b294-680142c4fd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.209322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55256a64-ee8b-4d5a-b294-680142c4fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.209678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55256a64-ee8b-4d5a-b294-680142c4fd54 admin admin] PATH_INFO: `/v3/users/4d345545b0ba4371b7c1d39b511f1539` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.211285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55256a64-ee8b-4d5a-b294-680142c4fd54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d345545b0ba4371b7c1d39b511f1539)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:48.213753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55256a64-ee8b-4d5a-b294-680142c4fd54 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:48.274024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125539d-2650-4659-b2f0-9e2b2cfb1e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:48.274704 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125539d-2650-4659-b2f0-9e2b2cfb1e56 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.274978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125539d-2650-4659-b2f0-9e2b2cfb1e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.275248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125539d-2650-4659-b2f0-9e2b2cfb1e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.277480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4125539d-2650-4659-b2f0-9e2b2cfb1e56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:48.289382 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-55256a64-ee8b-4d5a-b294-680142c4fd54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d345545b0ba4371b7c1d39b511f1539'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.312255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-55256a64-ee8b-4d5a-b294-680142c4fd54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d345545b0ba4371b7c1d39b511f1539'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.313236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-55256a64-ee8b-4d5a-b294-680142c4fd54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d345545b0ba4371b7c1d39b511f1539'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.325820 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-55256a64-ee8b-4d5a-b294-680142c4fd54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d345545b0ba4371b7c1d39b511f1539'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.337658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-55256a64-ee8b-4d5a-b294-680142c4fd54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d345545b0ba4371b7c1d39b511f1539'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.345810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1238/2474] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:48 2022] DELETE /identity/v3/users/4d345545b0ba4371b7c1d39b511f1539 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:48.348384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a88d6-5231-4d4a-ad48-863ea0f01917 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.348705 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a88d6-5231-4d4a-ad48-863ea0f01917 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.348992 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a88d6-5231-4d4a-ad48-863ea0f01917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.371908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-f27a88d6-5231-4d4a-ad48-863ea0f01917 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:48.373541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-f27a88d6-5231-4d4a-ad48-863ea0f01917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:48.402708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125539d-2650-4659-b2f0-9e2b2cfb1e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:48.405107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125539d-2650-4659-b2f0-9e2b2cfb1e56 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:48.416946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1237/2475] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:48 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:48.453954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1239/2476] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:48.473899 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6edd2-03be-4aaa-bf1a-7295e7b99f2c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.474315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6edd2-03be-4aaa-bf1a-7295e7b99f2c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.474479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6edd2-03be-4aaa-bf1a-7295e7b99f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.495223 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0cd6edd2-03be-4aaa-bf1a-7295e7b99f2c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:48.496466 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0cd6edd2-03be-4aaa-bf1a-7295e7b99f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:48.509137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1238/2477] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:48.509974 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a88d6-5231-4d4a-ad48-863ea0f01917 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:48.520445 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6edd2-03be-4aaa-bf1a-7295e7b99f2c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:48.521980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a88d6-5231-4d4a-ad48-863ea0f01917 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:48.522671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0cd6edd2-03be-4aaa-bf1a-7295e7b99f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:48.527670 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd47749-0059-4cf9-aed6-7c593ada9029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:48.528485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd47749-0059-4cf9-aed6-7c593ada9029 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.528646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd47749-0059-4cf9-aed6-7c593ada9029 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.528923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd47749-0059-4cf9-aed6-7c593ada9029 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.529813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd47749-0059-4cf9-aed6-7c593ada9029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:48.530410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd47749-0059-4cf9-aed6-7c593ada9029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:48.531791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd47749-0059-4cf9-aed6-7c593ada9029 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:48.547445 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1240/2478] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:56:48.551070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd47749-0059-4cf9-aed6-7c593ada9029 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:48.566287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd47749-0059-4cf9-aed6-7c593ada9029 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:48.571525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406853f3-59a1-42a7-9e83-dd202f36b02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:48.572264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406853f3-59a1-42a7-9e83-dd202f36b02a admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.572642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406853f3-59a1-42a7-9e83-dd202f36b02a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.572844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406853f3-59a1-42a7-9e83-dd202f36b02a admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.573667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406853f3-59a1-42a7-9e83-dd202f36b02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:48.575434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406853f3-59a1-42a7-9e83-dd202f36b02a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:48.606954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6edd2-03be-4aaa-bf1a-7295e7b99f2c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:48.608415 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1241/2479] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:48 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:48.612158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406853f3-59a1-42a7-9e83-dd202f36b02a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:48.676451 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5c1b1-314f-48fa-ae9a-f05151052952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:48.677174 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c1b1-314f-48fa-ae9a-f05151052952 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.677436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c1b1-314f-48fa-ae9a-f05151052952 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.677714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c1b1-314f-48fa-ae9a-f05151052952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.679800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-88a5c1b1-314f-48fa-ae9a-f05151052952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:48.700228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406853f3-59a1-42a7-9e83-dd202f36b02a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:48.711751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6a2aa-b162-46f1-8833-a9e454df19ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:48.713518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6a2aa-b162-46f1-8833-a9e454df19ec admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.713812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6a2aa-b162-46f1-8833-a9e454df19ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.715836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6a2aa-b162-46f1-8833-a9e454df19ec admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.716871 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6a2aa-b162-46f1-8833-a9e454df19ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:48.718970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6a2aa-b162-46f1-8833-a9e454df19ec admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:48.746522 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1242/2480] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:48 2022] POST /identity/v3/users => generated 284 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:48.747408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6a2aa-b162-46f1-8833-a9e454df19ec admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:48.752084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-6de6a2aa-b162-46f1-8833-a9e454df19ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:48.761020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5c1b1-314f-48fa-ae9a-f05151052952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:48.762611 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5c1b1-314f-48fa-ae9a-f05151052952 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:48.765185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6a2aa-b162-46f1-8833-a9e454df19ec admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:48.770566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:48.772066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.772349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.772624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] PATH_INFO: `/v3/projects/5779a75c29324b0a9320c624a5fd3ebb` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.773842 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5779a75c29324b0a9320c624a5fd3ebb)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:48.775950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:48.776982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1239/2481] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:56:48.777797 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5c1b1-314f-48fa-ae9a-f05151052952 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:48.801944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5c1b1-314f-48fa-ae9a-f05151052952 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:48.807122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681532-5780-475a-91cc-3b9673d12ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:48.807944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681532-5780-475a-91cc-3b9673d12ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.808539 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681532-5780-475a-91cc-3b9673d12ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.808690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681532-5780-475a-91cc-3b9673d12ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.809489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7681532-5780-475a-91cc-3b9673d12ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:48.811204 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7681532-5780-475a-91cc-3b9673d12ce2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:48.825156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1240/2482] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:48.829062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681532-5780-475a-91cc-3b9673d12ce2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:48.853946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681532-5780-475a-91cc-3b9673d12ce2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:48.875484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5779a75c29324b0a9320c624a5fd3ebb', 'request_id': 'req-dd873d08-1676-411c-be34-5acb198f9fe9'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.891298 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5779a75c29324b0a9320c624a5fd3ebb', 'request_id': 'req-dd873d08-1676-411c-be34-5acb198f9fe9'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.906552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5779a75c29324b0a9320c624a5fd3ebb', 'request_id': 'req-dd873d08-1676-411c-be34-5acb198f9fe9'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.929639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] The token cache is being invalidate because project 5779a75c29324b0a9320c624a5fd3ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:48.930208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.931042 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dd873d08-1676-411c-be34-5acb198f9fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:48.935075 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1243/2483] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:48 2022] DELETE /identity/v3/projects/5779a75c29324b0a9320c624a5fd3ebb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:48.941514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99854318-8a4f-4b88-8bc2-cc81567d99e4 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.942050 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99854318-8a4f-4b88-8bc2-cc81567d99e4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.942503 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99854318-8a4f-4b88-8bc2-cc81567d99e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.966602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fa620-3351-401b-9a26-7bc2dc28c7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:48.967550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa620-3351-401b-9a26-7bc2dc28c7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:48.968026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa620-3351-401b-9a26-7bc2dc28c7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:48.968633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa620-3351-401b-9a26-7bc2dc28c7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:48.969578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fa620-3351-401b-9a26-7bc2dc28c7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:48.971553 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fa620-3351-401b-9a26-7bc2dc28c7f6 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:48.984459 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-99854318-8a4f-4b88-8bc2-cc81567d99e4 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:48.985798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-99854318-8a4f-4b88-8bc2-cc81567d99e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:48.986156 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1241/2484] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:49.000237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fa620-3351-401b-9a26-7bc2dc28c7f6 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.000759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1244/2485] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:49.008591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4785b0-0376-4207-aeac-ac0f6ef2a771 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.009842 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0f2fa620-3351-401b-9a26-7bc2dc28c7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:49.010324 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4785b0-0376-4207-aeac-ac0f6ef2a771 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.011825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4785b0-0376-4207-aeac-ac0f6ef2a771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.028053 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fa620-3351-401b-9a26-7bc2dc28c7f6 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.036793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58b5b3-c303-457e-ab05-dfbbf258edd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.038186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b5b3-c303-457e-ab05-dfbbf258edd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.038617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b5b3-c303-457e-ab05-dfbbf258edd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.039006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b5b3-c303-457e-ab05-dfbbf258edd4 admin admin] PATH_INFO: `/v3/projects/05834458efdd404097f6a6f96e01c814/users/f08112c910ee4a88919f78644a843474/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.042567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-aa4785b0-0376-4207-aeac-ac0f6ef2a771 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:49.044106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-aa4785b0-0376-4207-aeac-ac0f6ef2a771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:49.059936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1245/2486] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:49.061257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4785b0-0376-4207-aeac-ac0f6ef2a771 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.061737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58b5b3-c303-457e-ab05-dfbbf258edd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05834458efdd404097f6a6f96e01c814, user_id=f08112c910ee4a88919f78644a843474, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.066118 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58b5b3-c303-457e-ab05-dfbbf258edd4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.073384 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4785b0-0376-4207-aeac-ac0f6ef2a771 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.078668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6389530-7717-4a37-a1c4-e47ef4393ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.079512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6389530-7717-4a37-a1c4-e47ef4393ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.079798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6389530-7717-4a37-a1c4-e47ef4393ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.082024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6389530-7717-4a37-a1c4-e47ef4393ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.082941 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6389530-7717-4a37-a1c4-e47ef4393ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:49.083135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6389530-7717-4a37-a1c4-e47ef4393ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.085116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6389530-7717-4a37-a1c4-e47ef4393ce7 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.094841 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1242/2487] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:48 2022] PUT /identity/v3/projects/05834458efdd404097f6a6f96e01c814/users/f08112c910ee4a88919f78644a843474/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:49.105629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8950b-7bb2-4067-9d96-fda5587cff69 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.106394 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8950b-7bb2-4067-9d96-fda5587cff69 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.106898 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8950b-7bb2-4067-9d96-fda5587cff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.114897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1246/2488] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:49.115906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6389530-7717-4a37-a1c4-e47ef4393ce7 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.128778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6389530-7717-4a37-a1c4-e47ef4393ce7 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.175876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4db8950b-7bb2-4067-9d96-fda5587cff69 None None] MFA Rules not processed for user `f08112c910ee4a88919f78644a843474`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:49.185724 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4db8950b-7bb2-4067-9d96-fda5587cff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:49.304166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deebad4-1ebc-4f8c-9f0a-4d316d673b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.304852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deebad4-1ebc-4f8c-9f0a-4d316d673b3f admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.305135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deebad4-1ebc-4f8c-9f0a-4d316d673b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.305514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deebad4-1ebc-4f8c-9f0a-4d316d673b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.306121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deebad4-1ebc-4f8c-9f0a-4d316d673b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.308408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deebad4-1ebc-4f8c-9f0a-4d316d673b3f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.363109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1247/2489] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:49 2022] POST /identity/v3/projects => generated 371 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:49.364637 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deebad4-1ebc-4f8c-9f0a-4d316d673b3f admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.368713 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7deebad4-1ebc-4f8c-9f0a-4d316d673b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:49.371692 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1243/2490] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:49.372923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8950b-7bb2-4067-9d96-fda5587cff69 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.404419 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8950b-7bb2-4067-9d96-fda5587cff69 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.474136 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deebad4-1ebc-4f8c-9f0a-4d316d673b3f admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.479144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e33c1c-5c6a-47d4-8c8b-1c86eea0219f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.480301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e33c1c-5c6a-47d4-8c8b-1c86eea0219f service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.480906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e33c1c-5c6a-47d4-8c8b-1c86eea0219f service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.481452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e33c1c-5c6a-47d4-8c8b-1c86eea0219f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.484074 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a3e33c1c-5c6a-47d4-8c8b-1c86eea0219f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:49.496917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff76e71-0b66-4cd1-ab4c-c7d4d4060389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.497631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff76e71-0b66-4cd1-ab4c-c7d4d4060389 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.497897 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff76e71-0b66-4cd1-ab4c-c7d4d4060389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.498153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff76e71-0b66-4cd1-ab4c-c7d4d4060389 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.499434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff76e71-0b66-4cd1-ab4c-c7d4d4060389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.501426 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff76e71-0b66-4cd1-ab4c-c7d4d4060389 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.534583 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1244/2491] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:49 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:49.535488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff76e71-0b66-4cd1-ab4c-c7d4d4060389 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.553516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff76e71-0b66-4cd1-ab4c-c7d4d4060389 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.559433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba15917-bc25-4691-a6f6-9574a00cc550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.560620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba15917-bc25-4691-a6f6-9574a00cc550 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.560620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba15917-bc25-4691-a6f6-9574a00cc550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.560837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba15917-bc25-4691-a6f6-9574a00cc550 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.561796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba15917-bc25-4691-a6f6-9574a00cc550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.563773 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba15917-bc25-4691-a6f6-9574a00cc550 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.582968 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e33c1c-5c6a-47d4-8c8b-1c86eea0219f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.585121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e33c1c-5c6a-47d4-8c8b-1c86eea0219f service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.598660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1248/2492] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:49.599936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e33c1c-5c6a-47d4-8c8b-1c86eea0219f service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.603569 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1245/2493] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:49 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:49.604709 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba15917-bc25-4691-a6f6-9574a00cc550 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.611272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e33c1c-5c6a-47d4-8c8b-1c86eea0219f service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.696045 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36281620-9973-4cd9-a2d5-b6597261de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.696734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36281620-9973-4cd9-a2d5-b6597261de1b admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.697181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36281620-9973-4cd9-a2d5-b6597261de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.697597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36281620-9973-4cd9-a2d5-b6597261de1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.698346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36281620-9973-4cd9-a2d5-b6597261de1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.700012 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36281620-9973-4cd9-a2d5-b6597261de1b admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.700312 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba15917-bc25-4691-a6f6-9574a00cc550 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.709784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260df5c0-3dee-4591-a30f-f60c5527491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.712753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df5c0-3dee-4591-a30f-f60c5527491e admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.715953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1249/2494] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:49.716570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df5c0-3dee-4591-a30f-f60c5527491e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.716570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df5c0-3dee-4591-a30f-f60c5527491e admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.716570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260df5c0-3dee-4591-a30f-f60c5527491e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.717360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260df5c0-3dee-4591-a30f-f60c5527491e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.725597 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36281620-9973-4cd9-a2d5-b6597261de1b admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.738098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36281620-9973-4cd9-a2d5-b6597261de1b admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.743761 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf037f-161e-4dd2-96b7-6b864e6937c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.744485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf037f-161e-4dd2-96b7-6b864e6937c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.744704 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1246/2495] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:49 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:49.747920 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf037f-161e-4dd2-96b7-6b864e6937c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.748214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf037f-161e-4dd2-96b7-6b864e6937c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.748645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260df5c0-3dee-4591-a30f-f60c5527491e admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.748982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf037f-161e-4dd2-96b7-6b864e6937c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.750760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf037f-161e-4dd2-96b7-6b864e6937c2 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.761518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260df5c0-3dee-4591-a30f-f60c5527491e admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.764274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1250/2496] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:49.766573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f18cc-8ece-4803-abe1-a6fb31ee7687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.767444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f18cc-8ece-4803-abe1-a6fb31ee7687 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.767873 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f18cc-8ece-4803-abe1-a6fb31ee7687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.768258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f18cc-8ece-4803-abe1-a6fb31ee7687 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.769051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf037f-161e-4dd2-96b7-6b864e6937c2 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.770848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f18cc-8ece-4803-abe1-a6fb31ee7687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.772729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f18cc-8ece-4803-abe1-a6fb31ee7687 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.784838 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf037f-161e-4dd2-96b7-6b864e6937c2 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.789530 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1247/2497] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:56:49.794011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f18cc-8ece-4803-abe1-a6fb31ee7687 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.803475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7370091-d434-4072-a865-0b4ffb9b8d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.804424 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7370091-d434-4072-a865-0b4ffb9b8d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.804710 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7370091-d434-4072-a865-0b4ffb9b8d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.804988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7370091-d434-4072-a865-0b4ffb9b8d2c admin admin] PATH_INFO: `/v3/projects/d8e71bba433349eb81f9a3cc4b0b9b4d/users/9d813f03273447c2ab0e152e238f34cf/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.813187 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f18cc-8ece-4803-abe1-a6fb31ee7687 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.819298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672cd2d-ce0e-49ca-833f-1fad6bdd90ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.820253 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672cd2d-ce0e-49ca-833f-1fad6bdd90ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.820652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672cd2d-ce0e-49ca-833f-1fad6bdd90ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.820840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672cd2d-ce0e-49ca-833f-1fad6bdd90ca admin admin] PATH_INFO: `/v3/projects/15d6ac403ef3444f8b4eb1b19a43552d/users/b6d68b7e4f8d4ab2a93387e2d312cbed/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.824702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7370091-d434-4072-a865-0b4ffb9b8d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e71bba433349eb81f9a3cc4b0b9b4d, user_id=9d813f03273447c2ab0e152e238f34cf, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.827360 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7370091-d434-4072-a865-0b4ffb9b8d2c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.839673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672cd2d-ce0e-49ca-833f-1fad6bdd90ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d6ac403ef3444f8b4eb1b19a43552d, user_id=b6d68b7e4f8d4ab2a93387e2d312cbed, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.844294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672cd2d-ce0e-49ca-833f-1fad6bdd90ca admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.860588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1251/2498] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:49 2022] PUT /identity/v3/projects/d8e71bba433349eb81f9a3cc4b0b9b4d/users/9d813f03273447c2ab0e152e238f34cf/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:49.860942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1248/2499] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:49 2022] PUT /identity/v3/projects/15d6ac403ef3444f8b4eb1b19a43552d/users/b6d68b7e4f8d4ab2a93387e2d312cbed/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:49.863612 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf622a-d571-436a-abba-ecf36d5fed42 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.864079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf622a-d571-436a-abba-ecf36d5fed42 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.864371 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf622a-d571-436a-abba-ecf36d5fed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.864669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672cd2d-ce0e-49ca-833f-1fad6bdd90ca admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.899814 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-80bf622a-d571-436a-abba-ecf36d5fed42 None None] MFA Rules not processed for user `9d813f03273447c2ab0e152e238f34cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:49.901124 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-80bf622a-d571-436a-abba-ecf36d5fed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:49.968340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672cd2d-ce0e-49ca-833f-1fad6bdd90ca admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:49.974337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e37c3-1feb-458c-ae90-1a5f948a1663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:49.974959 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e37c3-1feb-458c-ae90-1a5f948a1663 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:49.975259 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e37c3-1feb-458c-ae90-1a5f948a1663 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:49.975533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e37c3-1feb-458c-ae90-1a5f948a1663 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:49.976449 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e37c3-1feb-458c-ae90-1a5f948a1663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:49.978081 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e37c3-1feb-458c-ae90-1a5f948a1663 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:49.991792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1249/2500] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:49.992236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1252/2501] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:49.993786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e37c3-1feb-458c-ae90-1a5f948a1663 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:49.999789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf622a-d571-436a-abba-ecf36d5fed42 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:50.001363 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-80bf622a-d571-436a-abba-ecf36d5fed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:50.004547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e37c3-1feb-458c-ae90-1a5f948a1663 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:50.009332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25062e40-22cf-42e9-a242-755a6cb1c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:50.010219 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25062e40-22cf-42e9-a242-755a6cb1c6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:50.010655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25062e40-22cf-42e9-a242-755a6cb1c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:50.010937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25062e40-22cf-42e9-a242-755a6cb1c6d1 admin admin] PATH_INFO: `/v3/projects/15d6ac403ef3444f8b4eb1b19a43552d/users/b6d68b7e4f8d4ab2a93387e2d312cbed/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:50.012971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25062e40-22cf-42e9-a242-755a6cb1c6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d6ac403ef3444f8b4eb1b19a43552d, user_id=b6d68b7e4f8d4ab2a93387e2d312cbed, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:50.015604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25062e40-22cf-42e9-a242-755a6cb1c6d1 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:50.037181 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1250/2502] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:49 2022] PUT /identity/v3/projects/15d6ac403ef3444f8b4eb1b19a43552d/users/b6d68b7e4f8d4ab2a93387e2d312cbed/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:50.038776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5cf0-7d72-44fa-a480-41ab657db02c None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:50.039062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5cf0-7d72-44fa-a480-41ab657db02c None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:50.039340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5cf0-7d72-44fa-a480-41ab657db02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:50.066956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-c35a5cf0-7d72-44fa-a480-41ab657db02c None None] MFA Rules not processed for user `b6d68b7e4f8d4ab2a93387e2d312cbed`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:50.068064 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c35a5cf0-7d72-44fa-a480-41ab657db02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:50.071386 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf622a-d571-436a-abba-ecf36d5fed42 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:50.131534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a20e6-cac0-4a99-a2b3-0c1a8295d5cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0e623c10804239a076fc6cde9b198d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:50.132325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a20e6-cac0-4a99-a2b3-0c1a8295d5cd service glance] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:50.132534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a20e6-cac0-4a99-a2b3-0c1a8295d5cd service glance] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:50.132811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a20e6-cac0-4a99-a2b3-0c1a8295d5cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:50.154532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1251/2503] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:50.166112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5cf0-7d72-44fa-a480-41ab657db02c None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:50.168758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c35a5cf0-7d72-44fa-a480-41ab657db02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:50.199555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a20e6-cac0-4a99-a2b3-0c1a8295d5cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:50.201179 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a20e6-cac0-4a99-a2b3-0c1a8295d5cd service glance] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:50.212322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1253/2504] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:56:50.238255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5cf0-7d72-44fa-a480-41ab657db02c None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:50.242211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af4254-efca-4ee4-9149-8d3251a95e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:50.242863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4254-efca-4ee4-9149-8d3251a95e17 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:50.243143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4254-efca-4ee4-9149-8d3251a95e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:50.243428 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4254-efca-4ee4-9149-8d3251a95e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:50.254457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af4254-efca-4ee4-9149-8d3251a95e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:50.256249 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af4254-efca-4ee4-9149-8d3251a95e17 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:50.271082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1252/2505] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:56:50.519247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a20e6-cac0-4a99-a2b3-0c1a8295d5cd service glance] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:50.530537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a20e6-cac0-4a99-a2b3-0c1a8295d5cd service glance] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:50.534176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b389163-14e5-4c79-888c-76eb876767ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:50.535338 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b389163-14e5-4c79-888c-76eb876767ce service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:50.535651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b389163-14e5-4c79-888c-76eb876767ce service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:50.535965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b389163-14e5-4c79-888c-76eb876767ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:50.616744 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b389163-14e5-4c79-888c-76eb876767ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:50.618257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b389163-14e5-4c79-888c-76eb876767ce service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:50.634821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1254/2506] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:51.596727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af4254-efca-4ee4-9149-8d3251a95e17 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:51.598911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e6af4254-efca-4ee4-9149-8d3251a95e17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:51.691503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af4254-efca-4ee4-9149-8d3251a95e17 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:51.696489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:51.697393 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:51.697674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:51.697943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] PATH_INFO: `/v3/users/258580b81cf0480d9728500884442b55` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:51.699221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=258580b81cf0480d9728500884442b55)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:51.701293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:51.764954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258580b81cf0480d9728500884442b55'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:51.778480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258580b81cf0480d9728500884442b55'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:51.779274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258580b81cf0480d9728500884442b55'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:51.779890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258580b81cf0480d9728500884442b55'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:51.788592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258580b81cf0480d9728500884442b55'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:51.808773 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1253/2507] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:51 2022] DELETE /identity/v3/users/258580b81cf0480d9728500884442b55 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:52.014493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b389163-14e5-4c79-888c-76eb876767ce service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:52.044044 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b389163-14e5-4c79-888c-76eb876767ce service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:52.119256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:52.120398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:52.120825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:52.121114 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] PATH_INFO: `/v3/projects/405413536bdb433fbb7d03c8ccd34283` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:52.122347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=405413536bdb433fbb7d03c8ccd34283)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:52.124571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:52.222560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405413536bdb433fbb7d03c8ccd34283', 'request_id': 'req-63a97400-3a70-45ea-bbc9-4dbf63f204e5'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:52.229425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405413536bdb433fbb7d03c8ccd34283', 'request_id': 'req-63a97400-3a70-45ea-bbc9-4dbf63f204e5'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:52.252226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405413536bdb433fbb7d03c8ccd34283', 'request_id': 'req-63a97400-3a70-45ea-bbc9-4dbf63f204e5'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:52.268237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] The token cache is being invalidate because project 405413536bdb433fbb7d03c8ccd34283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:52.269306 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:52.270851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:52.272957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1255/2508] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:52 2022] DELETE /identity/v3/projects/405413536bdb433fbb7d03c8ccd34283 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:52.281520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:52.283070 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:52.298132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa8e36-0080-48a4-ab11-ba78b8e9e37c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:52.401406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:52.402586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:52.403070 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:52.403556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] PATH_INFO: `/v3/users/8ab482a96b4c43c9b418200d0b44ba05` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:52.406932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab482a96b4c43c9b418200d0b44ba05)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:52.409322 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:52.529378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab482a96b4c43c9b418200d0b44ba05'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:52.558923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab482a96b4c43c9b418200d0b44ba05'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:52.559747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab482a96b4c43c9b418200d0b44ba05'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:52.560368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab482a96b4c43c9b418200d0b44ba05'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:52.575768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab482a96b4c43c9b418200d0b44ba05'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:52.599744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1254/2509] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:52 2022] DELETE /identity/v3/users/8ab482a96b4c43c9b418200d0b44ba05 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:52.836528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:52.845165 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:52.879518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a97400-3a70-45ea-bbc9-4dbf63f204e5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:52.966845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:52.967739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:52.968028 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:52.968299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] PATH_INFO: `/v3/projects/73c1fb9d0eea4b9babc12af8a2e1f714` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:52.969690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c1fb9d0eea4b9babc12af8a2e1f714)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:52.972309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:53.042530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c1fb9d0eea4b9babc12af8a2e1f714', 'request_id': 'req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:53.049037 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c1fb9d0eea4b9babc12af8a2e1f714', 'request_id': 'req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:53.058637 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c1fb9d0eea4b9babc12af8a2e1f714', 'request_id': 'req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:53.070543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] The token cache is being invalidate because project 73c1fb9d0eea4b9babc12af8a2e1f714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:53.070812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:53.072379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-045e5cd1-72d3-4b92-8534-b1b67b4f0d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:53.074367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1256/2510] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:52 2022] DELETE /identity/v3/projects/73c1fb9d0eea4b9babc12af8a2e1f714 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:53.833517 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:53.836402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:53.857680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3ee0-6bd6-4806-96eb-07800219abe7 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:53.952568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:53.954441 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:53.956584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:53.958166 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] PATH_INFO: `/v3/users/0371f46a6bfc4f1d910c8ae7386a794f` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:53.967247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0371f46a6bfc4f1d910c8ae7386a794f)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:53.969617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:54.043925 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0371f46a6bfc4f1d910c8ae7386a794f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:54.065304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0371f46a6bfc4f1d910c8ae7386a794f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:54.068363 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0371f46a6bfc4f1d910c8ae7386a794f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:54.074954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0371f46a6bfc4f1d910c8ae7386a794f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:54.101002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0371f46a6bfc4f1d910c8ae7386a794f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:54.125020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1255/2511] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:53 2022] DELETE /identity/v3/users/0371f46a6bfc4f1d910c8ae7386a794f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:54.130176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59263f90-50fb-4932-919a-03c0eef63543 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:54.130735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59263f90-50fb-4932-919a-03c0eef63543 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:54.130735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59263f90-50fb-4932-919a-03c0eef63543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:54.168333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-59263f90-50fb-4932-919a-03c0eef63543 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:54.169805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-59263f90-50fb-4932-919a-03c0eef63543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:54.343441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1257/2512] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:54.371660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:54.372626 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:54.445949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2817fb-0752-41ff-9ab1-66c56bf5dc62 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:54.463459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa313fe-4f67-42cc-bcdd-5de1927f55ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:54.464182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa313fe-4f67-42cc-bcdd-5de1927f55ae service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:54.464545 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa313fe-4f67-42cc-bcdd-5de1927f55ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:54.464877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa313fe-4f67-42cc-bcdd-5de1927f55ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:54.479263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa313fe-4f67-42cc-bcdd-5de1927f55ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:54.480757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa313fe-4f67-42cc-bcdd-5de1927f55ae service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:54.481787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59263f90-50fb-4932-919a-03c0eef63543 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:54.482970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-59263f90-50fb-4932-919a-03c0eef63543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:54.493097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1256/2513] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:56:54.500146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59263f90-50fb-4932-919a-03c0eef63543 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:54.507567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:54.508766 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:54.509759 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:54.510199 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] PATH_INFO: `/v3/users/8928566ff693460f8243c43078a6a575` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:54.511856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8928566ff693460f8243c43078a6a575)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:54.513937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:54.586829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8928566ff693460f8243c43078a6a575'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:54.606922 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8928566ff693460f8243c43078a6a575'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:54.608536 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8928566ff693460f8243c43078a6a575'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:54.625556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8928566ff693460f8243c43078a6a575'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:54.635079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8928566ff693460f8243c43078a6a575'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:54.642732 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1258/2514] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:54 2022] DELETE /identity/v3/users/8928566ff693460f8243c43078a6a575 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:54.860075 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa313fe-4f67-42cc-bcdd-5de1927f55ae service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:54.863488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-efa313fe-4f67-42cc-bcdd-5de1927f55ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:54.897911 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa313fe-4f67-42cc-bcdd-5de1927f55ae service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:54.925047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:54.926631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:54.990575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:54.991561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:54.991942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:54.992289 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] PATH_INFO: `/v3/projects/71c745e694444de7b29f5fccf782fafd` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:54.993721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c745e694444de7b29f5fccf782fafd)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:54.995890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.012538 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605f60b-5d02-468d-9a32-07ad712d878f admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.017790 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.019315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.022137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.022137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] PATH_INFO: `/v3/projects/67cdad09821341cfa56bbc4642d2cd04` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.023967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cdad09821341cfa56bbc4642d2cd04)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.032398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.055520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c745e694444de7b29f5fccf782fafd', 'request_id': 'req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.064331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c745e694444de7b29f5fccf782fafd', 'request_id': 'req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.077572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c745e694444de7b29f5fccf782fafd', 'request_id': 'req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.088833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] The token cache is being invalidate because project 71c745e694444de7b29f5fccf782fafd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:55.089127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.089994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cdad09821341cfa56bbc4642d2cd04', 'request_id': 'req-b96a0d61-8a37-4890-9216-8fa5f7248253'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.090849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.093040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1257/2515] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:54 2022] DELETE /identity/v3/projects/71c745e694444de7b29f5fccf782fafd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:55.098074 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.099519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:55.101470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cdad09821341cfa56bbc4642d2cd04', 'request_id': 'req-b96a0d61-8a37-4890-9216-8fa5f7248253'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.110678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cdad09821341cfa56bbc4642d2cd04', 'request_id': 'req-b96a0d61-8a37-4890-9216-8fa5f7248253'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.127495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] The token cache is being invalidate because project 67cdad09821341cfa56bbc4642d2cd04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:55.127891 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.128605 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-b96a0d61-8a37-4890-9216-8fa5f7248253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.130241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1259/2516] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:54 2022] DELETE /identity/v3/projects/67cdad09821341cfa56bbc4642d2cd04 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:55.135402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35090908-4fe5-4221-bd36-562fcd064967 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.135696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35090908-4fe5-4221-bd36-562fcd064967 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.136013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35090908-4fe5-4221-bd36-562fcd064967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.158526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-35090908-4fe5-4221-bd36-562fcd064967 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:55.161085 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-35090908-4fe5-4221-bd36-562fcd064967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:55.177581 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d95c2-9e00-4ddc-9e60-04d0ddcba0f2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.229768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1260/2517] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:55.239758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905874d-35ca-4b5e-8a2a-53c38e447a86 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.240080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905874d-35ca-4b5e-8a2a-53c38e447a86 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.240416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905874d-35ca-4b5e-8a2a-53c38e447a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.250496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.251819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.252147 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.252379 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] PATH_INFO: `/v3/users/f8eab97f780a4140bac81ef18a9dabab` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.254473 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8eab97f780a4140bac81ef18a9dabab)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.256497 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.261020 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-d905874d-35ca-4b5e-8a2a-53c38e447a86 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:55.262248 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d905874d-35ca-4b5e-8a2a-53c38e447a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:55.277492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1261/2518] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:55.282460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905874d-35ca-4b5e-8a2a-53c38e447a86 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.293083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905874d-35ca-4b5e-8a2a-53c38e447a86 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.298443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4398e9e-e789-49c9-af81-04d7e6ebb05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.299105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4398e9e-e789-49c9-af81-04d7e6ebb05a admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.299383 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4398e9e-e789-49c9-af81-04d7e6ebb05a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.300226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4398e9e-e789-49c9-af81-04d7e6ebb05a admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.301408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4398e9e-e789-49c9-af81-04d7e6ebb05a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:55.301699 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4398e9e-e789-49c9-af81-04d7e6ebb05a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.303494 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4398e9e-e789-49c9-af81-04d7e6ebb05a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.314824 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8eab97f780a4140bac81ef18a9dabab'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.317034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1262/2519] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:55.323292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4398e9e-e789-49c9-af81-04d7e6ebb05a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.328804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8eab97f780a4140bac81ef18a9dabab'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.329560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8eab97f780a4140bac81ef18a9dabab'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.330205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8eab97f780a4140bac81ef18a9dabab'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.336705 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4398e9e-e789-49c9-af81-04d7e6ebb05a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.340863 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8eab97f780a4140bac81ef18a9dabab'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.345150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593db9-d7bf-4852-85a0-e45b38e421fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.346276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593db9-d7bf-4852-85a0-e45b38e421fb admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.347421 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593db9-d7bf-4852-85a0-e45b38e421fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.348201 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593db9-d7bf-4852-85a0-e45b38e421fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.349282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85593db9-d7bf-4852-85a0-e45b38e421fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.352598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85593db9-d7bf-4852-85a0-e45b38e421fb admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.355413 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1258/2520] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:55 2022] DELETE /identity/v3/users/f8eab97f780a4140bac81ef18a9dabab => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:55.389087 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1263/2521] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:55 2022] POST /identity/v3/projects => generated 403 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:56:55.393335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.394929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:55.490359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed992fbb-faaa-4114-bd12-c8831144c209 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.556509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88029c55-b10f-47d3-8b5c-3a7e752477cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.557208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88029c55-b10f-47d3-8b5c-3a7e752477cf admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.557529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88029c55-b10f-47d3-8b5c-3a7e752477cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.557777 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88029c55-b10f-47d3-8b5c-3a7e752477cf admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.558487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88029c55-b10f-47d3-8b5c-3a7e752477cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.560476 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88029c55-b10f-47d3-8b5c-3a7e752477cf admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.582560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1259/2522] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:55 2022] POST /identity/v3/users => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:56:55.586630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593db9-d7bf-4852-85a0-e45b38e421fb admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.601278 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593db9-d7bf-4852-85a0-e45b38e421fb admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.606346 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57012982-16db-44c6-aae5-4893ff9ecd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.607026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57012982-16db-44c6-aae5-4893ff9ecd91 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.607307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57012982-16db-44c6-aae5-4893ff9ecd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.607580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57012982-16db-44c6-aae5-4893ff9ecd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.608472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57012982-16db-44c6-aae5-4893ff9ecd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.610062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57012982-16db-44c6-aae5-4893ff9ecd91 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.620723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1264/2523] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:55.625005 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88029c55-b10f-47d3-8b5c-3a7e752477cf admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.636066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88029c55-b10f-47d3-8b5c-3a7e752477cf admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.648430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7b077-c06b-4ee7-ae1a-e470937b489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.649150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7b077-c06b-4ee7-ae1a-e470937b489b admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.649436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7b077-c06b-4ee7-ae1a-e470937b489b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.649714 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7b077-c06b-4ee7-ae1a-e470937b489b admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.650460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7b077-c06b-4ee7-ae1a-e470937b489b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.652139 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7b077-c06b-4ee7-ae1a-e470937b489b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.663459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1260/2524] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:55.667937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57012982-16db-44c6-aae5-4893ff9ecd91 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.684728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57012982-16db-44c6-aae5-4893ff9ecd91 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.692060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561f2f1-e854-4e69-9c4e-f9c5669f9cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.692970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561f2f1-e854-4e69-9c4e-f9c5669f9cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.693252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561f2f1-e854-4e69-9c4e-f9c5669f9cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.693532 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561f2f1-e854-4e69-9c4e-f9c5669f9cd2 admin admin] PATH_INFO: `/v3/projects/748ab04f33a044bd84110077eb692b99/users/a9fa52cfeee64926992b781bf53a292c/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.707256 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7b077-c06b-4ee7-ae1a-e470937b489b admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.709766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c2d7b077-c06b-4ee7-ae1a-e470937b489b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:55.714758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561f2f1-e854-4e69-9c4e-f9c5669f9cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748ab04f33a044bd84110077eb692b99, user_id=a9fa52cfeee64926992b781bf53a292c, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.718247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561f2f1-e854-4e69-9c4e-f9c5669f9cd2 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.735250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7b077-c06b-4ee7-ae1a-e470937b489b admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.743348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1265/2525] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:55 2022] PUT /identity/v3/projects/748ab04f33a044bd84110077eb692b99/users/a9fa52cfeee64926992b781bf53a292c/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:55.745242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d7ac-889b-49b8-ab28-8db971452782 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.745551 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d7ac-889b-49b8-ab28-8db971452782 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.745805 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d7ac-889b-49b8-ab28-8db971452782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.767301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-5769d7ac-889b-49b8-ab28-8db971452782 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:55.769312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5769d7ac-889b-49b8-ab28-8db971452782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:55.805131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.805988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.806269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.806545 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] PATH_INFO: `/v3/projects/4ac0b4dc6dd54229ae241bf65fa5a3cf` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.807802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac0b4dc6dd54229ae241bf65fa5a3cf)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:55.809761 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:55.836977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1266/2526] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:55.848166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769d7ac-889b-49b8-ab28-8db971452782 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:55.850092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5769d7ac-889b-49b8-ab28-8db971452782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:55.870241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac0b4dc6dd54229ae241bf65fa5a3cf', 'request_id': 'req-f9b502b8-dcd7-4d34-9792-33fdd4c10641'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.880363 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac0b4dc6dd54229ae241bf65fa5a3cf', 'request_id': 'req-f9b502b8-dcd7-4d34-9792-33fdd4c10641'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.894491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac0b4dc6dd54229ae241bf65fa5a3cf', 'request_id': 'req-f9b502b8-dcd7-4d34-9792-33fdd4c10641'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.905138 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] The token cache is being invalidate because project 4ac0b4dc6dd54229ae241bf65fa5a3cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:55.905406 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.906076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f9b502b8-dcd7-4d34-9792-33fdd4c10641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:55.907891 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1261/2527] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:55 2022] DELETE /identity/v3/projects/4ac0b4dc6dd54229ae241bf65fa5a3cf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:55.913212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedda79-9957-445f-916c-2bd068fb4cb5 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.915260 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedda79-9957-445f-916c-2bd068fb4cb5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.915260 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedda79-9957-445f-916c-2bd068fb4cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:55.929665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769d7ac-889b-49b8-ab28-8db971452782 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:55.933775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-acedda79-9957-445f-916c-2bd068fb4cb5 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:55.935861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-acedda79-9957-445f-916c-2bd068fb4cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:55.996924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d109a-6bdf-4cfb-9666-bc3e71393ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:55.998061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d109a-6bdf-4cfb-9666-bc3e71393ffd service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:55.998491 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d109a-6bdf-4cfb-9666-bc3e71393ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:55.998933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d109a-6bdf-4cfb-9666-bc3e71393ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.001631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-592d109a-6bdf-4cfb-9666-bc3e71393ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:56.004120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1262/2528] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:56.011793 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ec0d7-5341-476d-a455-1a8729284418 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.012092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ec0d7-5341-476d-a455-1a8729284418 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.012378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ec0d7-5341-476d-a455-1a8729284418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.021119 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d109a-6bdf-4cfb-9666-bc3e71393ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.023477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d109a-6bdf-4cfb-9666-bc3e71393ffd service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.035529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0e6ec0d7-5341-476d-a455-1a8729284418 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:56.035529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0e6ec0d7-5341-476d-a455-1a8729284418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:56.042372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1267/2529] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:56.044727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1263/2530] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:56.048817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d109a-6bdf-4cfb-9666-bc3e71393ffd service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.059159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d109a-6bdf-4cfb-9666-bc3e71393ffd service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.064592 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a83535-51f3-4025-b975-0e09e3f9ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.065302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a83535-51f3-4025-b975-0e09e3f9ede5 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.065581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a83535-51f3-4025-b975-0e09e3f9ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.065855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a83535-51f3-4025-b975-0e09e3f9ede5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.066820 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a83535-51f3-4025-b975-0e09e3f9ede5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:56.067131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a83535-51f3-4025-b975-0e09e3f9ede5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.068779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a83535-51f3-4025-b975-0e09e3f9ede5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.081304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1268/2531] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:56.085240 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ec0d7-5341-476d-a455-1a8729284418 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.095791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ec0d7-5341-476d-a455-1a8729284418 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.101346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9df31-04ce-41e3-8b61-b2168ec35fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.102019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9df31-04ce-41e3-8b61-b2168ec35fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.102305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9df31-04ce-41e3-8b61-b2168ec35fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.103016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9df31-04ce-41e3-8b61-b2168ec35fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.103409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9df31-04ce-41e3-8b61-b2168ec35fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.105555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9df31-04ce-41e3-8b61-b2168ec35fb7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.139776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1264/2532] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:56 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:56.144569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a83535-51f3-4025-b975-0e09e3f9ede5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.156174 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a83535-51f3-4025-b975-0e09e3f9ede5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.243240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a3ab6-368e-4c7b-86be-1401ec5c381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.244269 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a3ab6-368e-4c7b-86be-1401ec5c381f admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.244560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a3ab6-368e-4c7b-86be-1401ec5c381f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.244836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a3ab6-368e-4c7b-86be-1401ec5c381f admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.246106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a3ab6-368e-4c7b-86be-1401ec5c381f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.247837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a3ab6-368e-4c7b-86be-1401ec5c381f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.277358 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1269/2533] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:56 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:56.283575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9df31-04ce-41e3-8b61-b2168ec35fb7 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.291684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9df31-04ce-41e3-8b61-b2168ec35fb7 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.296602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc741c4-08d6-4ede-9391-d1bdddf569b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.297292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc741c4-08d6-4ede-9391-d1bdddf569b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.298094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc741c4-08d6-4ede-9391-d1bdddf569b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.298094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc741c4-08d6-4ede-9391-d1bdddf569b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.298598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc741c4-08d6-4ede-9391-d1bdddf569b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.300717 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc741c4-08d6-4ede-9391-d1bdddf569b7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.312552 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1265/2534] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:56:56.316950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a3ab6-368e-4c7b-86be-1401ec5c381f admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.328233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a3ab6-368e-4c7b-86be-1401ec5c381f admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.334574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309aaf60-21e2-46bb-81be-13a1cce060c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.335408 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaf60-21e2-46bb-81be-13a1cce060c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.335960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaf60-21e2-46bb-81be-13a1cce060c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.336368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaf60-21e2-46bb-81be-13a1cce060c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.337154 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309aaf60-21e2-46bb-81be-13a1cce060c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.338899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309aaf60-21e2-46bb-81be-13a1cce060c5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.357720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1270/2535] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:56.363949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc741c4-08d6-4ede-9391-d1bdddf569b7 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.367966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309aaf60-21e2-46bb-81be-13a1cce060c5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.369799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-309aaf60-21e2-46bb-81be-13a1cce060c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:56.378415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc741c4-08d6-4ede-9391-d1bdddf569b7 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.384352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed09d-9670-4c08-8492-08e14f8afb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.385337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed09d-9670-4c08-8492-08e14f8afb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.385690 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed09d-9670-4c08-8492-08e14f8afb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.385967 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed09d-9670-4c08-8492-08e14f8afb38 admin admin] PATH_INFO: `/v3/projects/cdf98769851c4e069ffb354856b910ab/users/98869f7b43364f46a6507d34a6b5f7db/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.388951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309aaf60-21e2-46bb-81be-13a1cce060c5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.394894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872ec68-3a92-42b1-82f7-4cd417b76f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.395830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ec68-3a92-42b1-82f7-4cd417b76f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.396321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ec68-3a92-42b1-82f7-4cd417b76f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.396714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ec68-3a92-42b1-82f7-4cd417b76f19 admin admin] PATH_INFO: `/v3/users/f08112c910ee4a88919f78644a843474` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.398409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872ec68-3a92-42b1-82f7-4cd417b76f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08112c910ee4a88919f78644a843474)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.400249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872ec68-3a92-42b1-82f7-4cd417b76f19 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.403381 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fed09d-9670-4c08-8492-08e14f8afb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf98769851c4e069ffb354856b910ab, user_id=98869f7b43364f46a6507d34a6b5f7db, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.406258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fed09d-9670-4c08-8492-08e14f8afb38 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.440597 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1266/2536] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:56 2022] PUT /identity/v3/projects/cdf98769851c4e069ffb354856b910ab/users/98869f7b43364f46a6507d34a6b5f7db/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:56.442760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162f4c-3f52-4d1e-b17d-d68085ac7408 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.443090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162f4c-3f52-4d1e-b17d-d68085ac7408 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.443372 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162f4c-3f52-4d1e-b17d-d68085ac7408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.480789 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d5162f4c-3f52-4d1e-b17d-d68085ac7408 None None] MFA Rules not processed for user `98869f7b43364f46a6507d34a6b5f7db`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:56.482060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d5162f4c-3f52-4d1e-b17d-d68085ac7408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:56.488856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f872ec68-3a92-42b1-82f7-4cd417b76f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08112c910ee4a88919f78644a843474'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:56.512528 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f872ec68-3a92-42b1-82f7-4cd417b76f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08112c910ee4a88919f78644a843474'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:56.513656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f872ec68-3a92-42b1-82f7-4cd417b76f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08112c910ee4a88919f78644a843474'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:56.524234 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f872ec68-3a92-42b1-82f7-4cd417b76f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08112c910ee4a88919f78644a843474'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:56.544739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f872ec68-3a92-42b1-82f7-4cd417b76f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08112c910ee4a88919f78644a843474'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:56.556675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1271/2537] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:56 2022] DELETE /identity/v3/users/f08112c910ee4a88919f78644a843474 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:56.561285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374020d-d4af-460c-a158-e01dc0fa8c19 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.561657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374020d-d4af-460c-a158-e01dc0fa8c19 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.562051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374020d-d4af-460c-a158-e01dc0fa8c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.603598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1267/2538] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:56.606336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-b374020d-d4af-460c-a158-e01dc0fa8c19 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:56.607733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5162f4c-3f52-4d1e-b17d-d68085ac7408 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.608526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b374020d-d4af-460c-a158-e01dc0fa8c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:56.609650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d5162f4c-3f52-4d1e-b17d-d68085ac7408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:56.703067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5162f4c-3f52-4d1e-b17d-d68085ac7408 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.709282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbf868-5b0b-493a-a393-34548bc32f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.713794 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1272/2539] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:56.714009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbf868-5b0b-493a-a393-34548bc32f41 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.714009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbf868-5b0b-493a-a393-34548bc32f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.714009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbf868-5b0b-493a-a393-34548bc32f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.714009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbf868-5b0b-493a-a393-34548bc32f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.717876 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbf868-5b0b-493a-a393-34548bc32f41 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.733843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374020d-d4af-460c-a158-e01dc0fa8c19 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.735699 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b374020d-d4af-460c-a158-e01dc0fa8c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:56.755982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1268/2540] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:56 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:56.757216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbf868-5b0b-493a-a393-34548bc32f41 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.844366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374020d-d4af-460c-a158-e01dc0fa8c19 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.857971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbf868-5b0b-493a-a393-34548bc32f41 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.866202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2616f-1135-403b-943c-225707af3281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.867924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2616f-1135-403b-943c-225707af3281 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.868962 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2616f-1135-403b-943c-225707af3281 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.869717 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2616f-1135-403b-943c-225707af3281 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.870661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2616f-1135-403b-943c-225707af3281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.874807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2616f-1135-403b-943c-225707af3281 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.906007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1269/2541] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:56 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:56.908817 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2a188-8030-46ef-b111-1492187d6f24 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.910859 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2a188-8030-46ef-b111-1492187d6f24 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.911536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2a188-8030-46ef-b111-1492187d6f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.926400 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182f3b7-6c7a-4bf2-ad27-e5c218a1c839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.927029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182f3b7-6c7a-4bf2-ad27-e5c218a1c839 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.927300 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182f3b7-6c7a-4bf2-ad27-e5c218a1c839 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.927576 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182f3b7-6c7a-4bf2-ad27-e5c218a1c839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.948085 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182f3b7-6c7a-4bf2-ad27-e5c218a1c839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.949524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182f3b7-6c7a-4bf2-ad27-e5c218a1c839 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:56.958452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-86e2a188-8030-46ef-b111-1492187d6f24 None None] MFA Rules not processed for user `a9fa52cfeee64926992b781bf53a292c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:56.959729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-86e2a188-8030-46ef-b111-1492187d6f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:56.964937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1273/2542] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:56:56.966485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182f3b7-6c7a-4bf2-ad27-e5c218a1c839 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:56.977852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182f3b7-6c7a-4bf2-ad27-e5c218a1c839 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:56.983089 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cc6cc-61ab-4799-b149-9acd81e70fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:56.984072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cc6cc-61ab-4799-b149-9acd81e70fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:56.984429 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cc6cc-61ab-4799-b149-9acd81e70fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:56.984820 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cc6cc-61ab-4799-b149-9acd81e70fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:56.985959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cc6cc-61ab-4799-b149-9acd81e70fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:56.988906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cc6cc-61ab-4799-b149-9acd81e70fd5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:57.001413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1274/2543] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:57.012964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cc6cc-61ab-4799-b149-9acd81e70fd5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:57.026998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cc6cc-61ab-4799-b149-9acd81e70fd5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:57.034716 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768beccc-a764-4e64-aa92-023f9c4981b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:57.036573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768beccc-a764-4e64-aa92-023f9c4981b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.036573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768beccc-a764-4e64-aa92-023f9c4981b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.038099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768beccc-a764-4e64-aa92-023f9c4981b8 admin admin] PATH_INFO: `/v3/projects/91a94660231c42e38aea36cd66e25136/users/aeeaf697e55a4a51a40494aca705fb68/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.067926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768beccc-a764-4e64-aa92-023f9c4981b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a94660231c42e38aea36cd66e25136, user_id=aeeaf697e55a4a51a40494aca705fb68, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:57.071591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768beccc-a764-4e64-aa92-023f9c4981b8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:57.081471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1270/2544] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:57.094715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2a188-8030-46ef-b111-1492187d6f24 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:57.096287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-86e2a188-8030-46ef-b111-1492187d6f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:57.108560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1275/2545] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:57 2022] PUT /identity/v3/projects/91a94660231c42e38aea36cd66e25136/users/aeeaf697e55a4a51a40494aca705fb68/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:57.112899 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768beccc-a764-4e64-aa92-023f9c4981b8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:57.114688 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2a188-8030-46ef-b111-1492187d6f24 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:57.190810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812925f-94d1-41b7-a9ef-67b690292ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:57.191608 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812925f-94d1-41b7-a9ef-67b690292ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.191804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812925f-94d1-41b7-a9ef-67b690292ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.192070 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812925f-94d1-41b7-a9ef-67b690292ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.192809 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812925f-94d1-41b7-a9ef-67b690292ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:57.194730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812925f-94d1-41b7-a9ef-67b690292ab2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:57.195280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768beccc-a764-4e64-aa92-023f9c4981b8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:57.203540 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabbd32-4f7b-463a-ae55-02bce269c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:57.204525 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbd32-4f7b-463a-ae55-02bce269c5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.204806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbd32-4f7b-463a-ae55-02bce269c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.205079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbd32-4f7b-463a-ae55-02bce269c5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.207514 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabbd32-4f7b-463a-ae55-02bce269c5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:57.209338 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabbd32-4f7b-463a-ae55-02bce269c5c7 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:57.220840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1276/2546] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:57.225621 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabbd32-4f7b-463a-ae55-02bce269c5c7 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:57.232960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1271/2547] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:57 2022] POST /identity/v3/projects => generated 403 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:57.238860 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812925f-94d1-41b7-a9ef-67b690292ab2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:57.239223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabbd32-4f7b-463a-ae55-02bce269c5c7 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:57.307305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe82e2-ba85-4a8c-aed9-b8b6d8270847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:57.308446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe82e2-ba85-4a8c-aed9-b8b6d8270847 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.308741 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe82e2-ba85-4a8c-aed9-b8b6d8270847 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.309013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe82e2-ba85-4a8c-aed9-b8b6d8270847 admin admin] PATH_INFO: `/v3/projects/91a94660231c42e38aea36cd66e25136/users/aeeaf697e55a4a51a40494aca705fb68/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.311305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe82e2-ba85-4a8c-aed9-b8b6d8270847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a94660231c42e38aea36cd66e25136, user_id=aeeaf697e55a4a51a40494aca705fb68, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:57.314344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe82e2-ba85-4a8c-aed9-b8b6d8270847 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:57.323954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812925f-94d1-41b7-a9ef-67b690292ab2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:57.327773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1277/2548] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:57 2022] PUT /identity/v3/projects/91a94660231c42e38aea36cd66e25136/users/aeeaf697e55a4a51a40494aca705fb68/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:57.338409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe82e2-ba85-4a8c-aed9-b8b6d8270847 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:57.340492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-30fe82e2-ba85-4a8c-aed9-b8b6d8270847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:57.388805 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd5013-1484-443c-a691-eee9a80b7f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:57.389482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd5013-1484-443c-a691-eee9a80b7f66 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.389763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd5013-1484-443c-a691-eee9a80b7f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.390041 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd5013-1484-443c-a691-eee9a80b7f66 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.390726 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd5013-1484-443c-a691-eee9a80b7f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:57.392918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd5013-1484-443c-a691-eee9a80b7f66 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:57.412610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe82e2-ba85-4a8c-aed9-b8b6d8270847 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:57.417616 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:57.421229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1272/2549] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:57 2022] POST /identity/v3/users => generated 308 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:57.421386 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.421386 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.421386 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] PATH_INFO: `/v3/projects/05834458efdd404097f6a6f96e01c814` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.421658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba672e-fd71-48e5-b697-1e17ecdbb1fa None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.421658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba672e-fd71-48e5-b697-1e17ecdbb1fa None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.421658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba672e-fd71-48e5-b697-1e17ecdbb1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.421893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=05834458efdd404097f6a6f96e01c814)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:57.422285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:57.449878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-e1ba672e-fd71-48e5-b697-1e17ecdbb1fa None None] MFA Rules not processed for user `aeeaf697e55a4a51a40494aca705fb68`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:57.451663 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e1ba672e-fd71-48e5-b697-1e17ecdbb1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:57.483449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05834458efdd404097f6a6f96e01c814', 'request_id': 'req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:57.494653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05834458efdd404097f6a6f96e01c814', 'request_id': 'req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:57.506392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05834458efdd404097f6a6f96e01c814', 'request_id': 'req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:57.520755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] The token cache is being invalidate because project 05834458efdd404097f6a6f96e01c814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:57.521339 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:57.522012 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:57.523861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1278/2550] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:57 2022] DELETE /identity/v3/projects/05834458efdd404097f6a6f96e01c814 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:57.527378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:57.528821 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:57.561016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1273/2551] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:57.562246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba672e-fd71-48e5-b697-1e17ecdbb1fa None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:57.563585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e1ba672e-fd71-48e5-b697-1e17ecdbb1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:57.576814 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba672e-fd71-48e5-b697-1e17ecdbb1fa None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:57.611544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464f223-b4e0-47d7-902d-1e4ffeb6aa2d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:57.617309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f1872-c8b5-41a1-9883-1d684bdc1622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:57.618062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1872-c8b5-41a1-9883-1d684bdc1622 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.619204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1872-c8b5-41a1-9883-1d684bdc1622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.619204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1872-c8b5-41a1-9883-1d684bdc1622 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.619398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f1872-c8b5-41a1-9883-1d684bdc1622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:57.620998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f1872-c8b5-41a1-9883-1d684bdc1622 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:57.635078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1279/2552] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:57.636106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f1872-c8b5-41a1-9883-1d684bdc1622 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:57.639779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-d93f1872-c8b5-41a1-9883-1d684bdc1622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:57.642083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:57.642969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.643285 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.643562 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] PATH_INFO: `/v3/users/b6d68b7e4f8d4ab2a93387e2d312cbed` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.645022 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d68b7e4f8d4ab2a93387e2d312cbed)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:57.646949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:57.696848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d68b7e4f8d4ab2a93387e2d312cbed'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:57.702024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f1872-c8b5-41a1-9883-1d684bdc1622 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:57.705641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59767-907b-4493-96e7-765365517b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:57.706931 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59767-907b-4493-96e7-765365517b48 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.707221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59767-907b-4493-96e7-765365517b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.707488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59767-907b-4493-96e7-765365517b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.709758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d68b7e4f8d4ab2a93387e2d312cbed'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:57.710604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d68b7e4f8d4ab2a93387e2d312cbed'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:57.711313 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d68b7e4f8d4ab2a93387e2d312cbed'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:57.720993 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d68b7e4f8d4ab2a93387e2d312cbed'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:57.734504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1274/2553] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:57 2022] DELETE /identity/v3/users/b6d68b7e4f8d4ab2a93387e2d312cbed => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:57.735513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:57.736955 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:57.795601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd59767-907b-4493-96e7-765365517b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:57.797341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd59767-907b-4493-96e7-765365517b48 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:57.808523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1280/2554] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:57.816127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36db5-3e35-448d-bf9f-a1295fd01264 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:57.822408 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a12cbf-0c0a-4316-9edc-5f9f8ddaebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:57.826738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a12cbf-0c0a-4316-9edc-5f9f8ddaebe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.827024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a12cbf-0c0a-4316-9edc-5f9f8ddaebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.827308 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a12cbf-0c0a-4316-9edc-5f9f8ddaebe2 admin admin] PATH_INFO: `/v3/projects/1892f4691c3e4ec9a1f0c967761d51f5/users/df6adaaeba5e4e9799be7958bf4e589b/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.848270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a12cbf-0c0a-4316-9edc-5f9f8ddaebe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1892f4691c3e4ec9a1f0c967761d51f5, user_id=df6adaaeba5e4e9799be7958bf4e589b, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:57.851208 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a12cbf-0c0a-4316-9edc-5f9f8ddaebe2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:57.880639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1275/2555] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:57 2022] PUT /identity/v3/projects/1892f4691c3e4ec9a1f0c967761d51f5/users/df6adaaeba5e4e9799be7958bf4e589b/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:57.883740 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59767-907b-4493-96e7-765365517b48 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:57.896878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59767-907b-4493-96e7-765365517b48 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:57.988767 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b085c6a-e4c3-44cb-874b-31ae8a948933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:57.989456 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b085c6a-e4c3-44cb-874b-31ae8a948933 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:57.989739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b085c6a-e4c3-44cb-874b-31ae8a948933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:57.990080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b085c6a-e4c3-44cb-874b-31ae8a948933 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:57.991014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b085c6a-e4c3-44cb-874b-31ae8a948933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:57.992661 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b085c6a-e4c3-44cb-874b-31ae8a948933 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:58.007761 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1281/2556] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:58.014293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a12cbf-0c0a-4316-9edc-5f9f8ddaebe2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:58.029949 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a12cbf-0c0a-4316-9edc-5f9f8ddaebe2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:58.037722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4069e-451c-4802-a3d8-0667aa58215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:58.042276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4069e-451c-4802-a3d8-0667aa58215a admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.042276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4069e-451c-4802-a3d8-0667aa58215a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.042276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4069e-451c-4802-a3d8-0667aa58215a admin admin] PATH_INFO: `/v3/projects/1892f4691c3e4ec9a1f0c967761d51f5/users/df6adaaeba5e4e9799be7958bf4e589b/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.042573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4069e-451c-4802-a3d8-0667aa58215a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1892f4691c3e4ec9a1f0c967761d51f5, user_id=df6adaaeba5e4e9799be7958bf4e589b, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:58.046039 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4069e-451c-4802-a3d8-0667aa58215a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:58.059533 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1276/2557] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:58 2022] PUT /identity/v3/projects/1892f4691c3e4ec9a1f0c967761d51f5/users/df6adaaeba5e4e9799be7958bf4e589b/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:58.116134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b085c6a-e4c3-44cb-874b-31ae8a948933 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:58.117933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4b085c6a-e4c3-44cb-874b-31ae8a948933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:58.135277 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b085c6a-e4c3-44cb-874b-31ae8a948933 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:58.239051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:58.240063 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.240643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.241181 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] PATH_INFO: `/v3/projects/15d6ac403ef3444f8b4eb1b19a43552d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.242621 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d6ac403ef3444f8b4eb1b19a43552d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:58.245728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:58.320044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4069e-451c-4802-a3d8-0667aa58215a admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:58.321879 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-84b4069e-451c-4802-a3d8-0667aa58215a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:58.339114 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4069e-451c-4802-a3d8-0667aa58215a admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:58.346292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d6ac403ef3444f8b4eb1b19a43552d', 'request_id': 'req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:58.356029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d6ac403ef3444f8b4eb1b19a43552d', 'request_id': 'req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:58.369246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d6ac403ef3444f8b4eb1b19a43552d', 'request_id': 'req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:58.383782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] The token cache is being invalidate because project 15d6ac403ef3444f8b4eb1b19a43552d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:58.384086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:58.384792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6b30e98d-6012-4bc1-bcc7-343f6a1b3b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:58.388342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1282/2558] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:58 2022] DELETE /identity/v3/projects/15d6ac403ef3444f8b4eb1b19a43552d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:58.398447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d3014-c8e1-4a37-83f4-37e042209898 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.398447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d3014-c8e1-4a37-83f4-37e042209898 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.398447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d3014-c8e1-4a37-83f4-37e042209898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.423032 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-f10d3014-c8e1-4a37-83f4-37e042209898 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:58.424901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-f10d3014-c8e1-4a37-83f4-37e042209898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:58.446507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a8736-2e7e-4002-bf80-1d7e43c59a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:58.447555 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a8736-2e7e-4002-bf80-1d7e43c59a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.447884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a8736-2e7e-4002-bf80-1d7e43c59a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.448261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a8736-2e7e-4002-bf80-1d7e43c59a09 admin admin] PATH_INFO: `/v3/users/98869f7b43364f46a6507d34a6b5f7db` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.449693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a8736-2e7e-4002-bf80-1d7e43c59a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98869f7b43364f46a6507d34a6b5f7db)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:58.452094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a8736-2e7e-4002-bf80-1d7e43c59a09 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:58.531460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5c3a8736-2e7e-4002-bf80-1d7e43c59a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98869f7b43364f46a6507d34a6b5f7db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:58.533126 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1283/2559] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:58.544907 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be85914-6010-4dc2-a923-6296e9fb216c None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.545526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be85914-6010-4dc2-a923-6296e9fb216c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.546246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be85914-6010-4dc2-a923-6296e9fb216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.554855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5c3a8736-2e7e-4002-bf80-1d7e43c59a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98869f7b43364f46a6507d34a6b5f7db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:58.570532 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5c3a8736-2e7e-4002-bf80-1d7e43c59a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98869f7b43364f46a6507d34a6b5f7db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:58.573183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5c3a8736-2e7e-4002-bf80-1d7e43c59a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98869f7b43364f46a6507d34a6b5f7db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:58.574601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-7be85914-6010-4dc2-a923-6296e9fb216c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:58.576213 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7be85914-6010-4dc2-a923-6296e9fb216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:58.586296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5c3a8736-2e7e-4002-bf80-1d7e43c59a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98869f7b43364f46a6507d34a6b5f7db'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:58.590457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1284/2560] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:58.597476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be85914-6010-4dc2-a923-6296e9fb216c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:58.611519 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be85914-6010-4dc2-a923-6296e9fb216c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:58.614445 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1277/2561] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:58 2022] DELETE /identity/v3/users/98869f7b43364f46a6507d34a6b5f7db => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:58.619192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e61f8-ca34-44b6-a24a-a7c1c2556080 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.619530 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e61f8-ca34-44b6-a24a-a7c1c2556080 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.619813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e61f8-ca34-44b6-a24a-a7c1c2556080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.652762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f66e61f8-ca34-44b6-a24a-a7c1c2556080 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:58.653628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f66e61f8-ca34-44b6-a24a-a7c1c2556080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:58.696104 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc93473-34f8-43dc-bee3-32d7628323cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:58.697018 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc93473-34f8-43dc-bee3-32d7628323cf admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.697736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc93473-34f8-43dc-bee3-32d7628323cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.697736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc93473-34f8-43dc-bee3-32d7628323cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.698481 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc93473-34f8-43dc-bee3-32d7628323cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:56:58.698781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc93473-34f8-43dc-bee3-32d7628323cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:58.700700 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc93473-34f8-43dc-bee3-32d7628323cf admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:58.714439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1285/2562] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:56:58.719307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc93473-34f8-43dc-bee3-32d7628323cf admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:58.730088 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1278/2563] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:58.732186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e61f8-ca34-44b6-a24a-a7c1c2556080 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:58.734722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f66e61f8-ca34-44b6-a24a-a7c1c2556080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:58.736903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc93473-34f8-43dc-bee3-32d7628323cf admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:58.742465 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06cddf-b2bd-4d35-bbdc-c3fdc67c51b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:58.743137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06cddf-b2bd-4d35-bbdc-c3fdc67c51b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.743419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06cddf-b2bd-4d35-bbdc-c3fdc67c51b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.743700 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06cddf-b2bd-4d35-bbdc-c3fdc67c51b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.744438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06cddf-b2bd-4d35-bbdc-c3fdc67c51b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:58.746653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06cddf-b2bd-4d35-bbdc-c3fdc67c51b4 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:58.790069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1286/2564] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:56:58 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:56:58.791472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06cddf-b2bd-4d35-bbdc-c3fdc67c51b4 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:58.812517 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e61f8-ca34-44b6-a24a-a7c1c2556080 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:58.893043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06cddf-b2bd-4d35-bbdc-c3fdc67c51b4 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:58.899611 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9b576-4099-4f1c-97f8-7a0d9c0b4d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:58.900352 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9b576-4099-4f1c-97f8-7a0d9c0b4d4c admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.900623 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9b576-4099-4f1c-97f8-7a0d9c0b4d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.900907 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9b576-4099-4f1c-97f8-7a0d9c0b4d4c admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.901616 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9b576-4099-4f1c-97f8-7a0d9c0b4d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:58.903751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9b576-4099-4f1c-97f8-7a0d9c0b4d4c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:58.908691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f03e33-a345-4cbc-8106-d723ff8f79cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:58.909910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f03e33-a345-4cbc-8106-d723ff8f79cd service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.910426 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f03e33-a345-4cbc-8106-d723ff8f79cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.910990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f03e33-a345-4cbc-8106-d723ff8f79cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.923697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f03e33-a345-4cbc-8106-d723ff8f79cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:58.926558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f03e33-a345-4cbc-8106-d723ff8f79cd service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:58.932034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1287/2565] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:56:58 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:56:58.933717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9571a-1d44-4874-980e-8f88800f0a4a None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.934184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9571a-1d44-4874-980e-8f88800f0a4a None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.934643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9571a-1d44-4874-980e-8f88800f0a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.937737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1279/2566] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:56:58.938748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f03e33-a345-4cbc-8106-d723ff8f79cd service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:58.954545 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f03e33-a345-4cbc-8106-d723ff8f79cd service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:58.960846 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad4e0d-aef7-49e2-8157-7d0bf3687261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:58.962676 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4e0d-aef7-49e2-8157-7d0bf3687261 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:58.962963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4e0d-aef7-49e2-8157-7d0bf3687261 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:58.963241 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4e0d-aef7-49e2-8157-7d0bf3687261 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:58.964138 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad4e0d-aef7-49e2-8157-7d0bf3687261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:58.965774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad4e0d-aef7-49e2-8157-7d0bf3687261 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:58.983450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1280/2567] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:56:58.989195 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad4e0d-aef7-49e2-8157-7d0bf3687261 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:58.995626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-0bd9571a-1d44-4874-980e-8f88800f0a4a None None] MFA Rules not processed for user `df6adaaeba5e4e9799be7958bf4e589b`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:58.998734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0bd9571a-1d44-4874-980e-8f88800f0a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:59.002051 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad4e0d-aef7-49e2-8157-7d0bf3687261 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:59.009944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573e113-6a4c-463b-a66b-a41146216c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:59.010649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573e113-6a4c-463b-a66b-a41146216c93 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:59.010931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573e113-6a4c-463b-a66b-a41146216c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:59.011195 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573e113-6a4c-463b-a66b-a41146216c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:59.012945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573e113-6a4c-463b-a66b-a41146216c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:59.018999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573e113-6a4c-463b-a66b-a41146216c93 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:59.031205 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1281/2568] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:56:59.037019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573e113-6a4c-463b-a66b-a41146216c93 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:59.051951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573e113-6a4c-463b-a66b-a41146216c93 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:59.059811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb76f9-2ee3-40b9-a59b-7a30be2edbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:59.061316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb76f9-2ee3-40b9-a59b-7a30be2edbd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:59.061759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb76f9-2ee3-40b9-a59b-7a30be2edbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:59.062199 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb76f9-2ee3-40b9-a59b-7a30be2edbd3 admin admin] PATH_INFO: `/v3/projects/4b5c01d20af241a69c422ee0e62a9479/users/44fda444cbf84fb1a15468d3afdfb3ba/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:59.094029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb76f9-2ee3-40b9-a59b-7a30be2edbd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5c01d20af241a69c422ee0e62a9479, user_id=44fda444cbf84fb1a15468d3afdfb3ba, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:59.098092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb76f9-2ee3-40b9-a59b-7a30be2edbd3 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:59.139802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1282/2569] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:56:59 2022] PUT /identity/v3/projects/4b5c01d20af241a69c422ee0e62a9479/users/44fda444cbf84fb1a15468d3afdfb3ba/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:59.140023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1288/2570] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:59.153035 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c7683-f52f-46d5-8200-2c4773f71362 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:59.153462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c7683-f52f-46d5-8200-2c4773f71362 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:59.153980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c7683-f52f-46d5-8200-2c4773f71362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:59.197907 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4a4c7683-f52f-46d5-8200-2c4773f71362 None None] MFA Rules not processed for user `44fda444cbf84fb1a15468d3afdfb3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:59.199284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4a4c7683-f52f-46d5-8200-2c4773f71362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:59.278998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1283/2571] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:56:59.290989 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9571a-1d44-4874-980e-8f88800f0a4a None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:59.292671 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-0bd9571a-1d44-4874-980e-8f88800f0a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:59.316402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c7683-f52f-46d5-8200-2c4773f71362 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:59.317810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4a4c7683-f52f-46d5-8200-2c4773f71362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:59.379550 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9571a-1d44-4874-980e-8f88800f0a4a None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:59.408999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c7683-f52f-46d5-8200-2c4773f71362 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:59.414220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:59.415131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:59.415404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:59.415875 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] PATH_INFO: `/v3/projects/cdf98769851c4e069ffb354856b910ab` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:59.417126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf98769851c4e069ffb354856b910ab)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:59.419116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:59.454197 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf21d9-6080-4fb2-845e-ee17c9817812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:59.454923 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf21d9-6080-4fb2-845e-ee17c9817812 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:59.455274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf21d9-6080-4fb2-845e-ee17c9817812 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:59.456339 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf21d9-6080-4fb2-845e-ee17c9817812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:59.467735 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf21d9-6080-4fb2-845e-ee17c9817812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:59.469531 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf21d9-6080-4fb2-845e-ee17c9817812 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:59.485521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1289/2572] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:56:59.496683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf98769851c4e069ffb354856b910ab', 'request_id': 'req-90325069-3cd1-4687-9618-5fece771619a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.508933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf21d9-6080-4fb2-845e-ee17c9817812 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:59.509969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf98769851c4e069ffb354856b910ab', 'request_id': 'req-90325069-3cd1-4687-9618-5fece771619a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.519646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf98769851c4e069ffb354856b910ab', 'request_id': 'req-90325069-3cd1-4687-9618-5fece771619a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.521580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf21d9-6080-4fb2-845e-ee17c9817812 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:59.532266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] The token cache is being invalidate because project cdf98769851c4e069ffb354856b910ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:56:59.532548 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.533305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.536045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1284/2573] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:56:59 2022] DELETE /identity/v3/projects/cdf98769851c4e069ffb354856b910ab => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:56:59.539546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:59.541375 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:59.593953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8a45e-e706-4764-9b57-3ae1b2f74c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:59.594963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8a45e-e706-4764-9b57-3ae1b2f74c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:59.595309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8a45e-e706-4764-9b57-3ae1b2f74c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:59.595658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8a45e-e706-4764-9b57-3ae1b2f74c86 admin admin] PATH_INFO: `/v3/users/44fda444cbf84fb1a15468d3afdfb3ba` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:59.598070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8a45e-e706-4764-9b57-3ae1b2f74c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44fda444cbf84fb1a15468d3afdfb3ba)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:59.600433 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8a45e-e706-4764-9b57-3ae1b2f74c86 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:59.619370 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90325069-3cd1-4687-9618-5fece771619a admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:59.635615 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:59.636763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:59.637038 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:59.637480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] PATH_INFO: `/v3/users/aeeaf697e55a4a51a40494aca705fb68` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:59.639006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeeaf697e55a4a51a40494aca705fb68)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:59.641188 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:59.671827 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5ab8a45e-e706-4764-9b57-3ae1b2f74c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44fda444cbf84fb1a15468d3afdfb3ba'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.702789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5ab8a45e-e706-4764-9b57-3ae1b2f74c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44fda444cbf84fb1a15468d3afdfb3ba'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.704001 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5ab8a45e-e706-4764-9b57-3ae1b2f74c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44fda444cbf84fb1a15468d3afdfb3ba'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.715156 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5ab8a45e-e706-4764-9b57-3ae1b2f74c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44fda444cbf84fb1a15468d3afdfb3ba'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.719339 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeeaf697e55a4a51a40494aca705fb68'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.726749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5ab8a45e-e706-4764-9b57-3ae1b2f74c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44fda444cbf84fb1a15468d3afdfb3ba'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.734515 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1290/2574] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:59 2022] DELETE /identity/v3/users/44fda444cbf84fb1a15468d3afdfb3ba => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:59.738353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeeaf697e55a4a51a40494aca705fb68'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.741434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeeaf697e55a4a51a40494aca705fb68'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.741541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf50080-af6b-49da-bfe0-35d4bf739b6c None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:59.741541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf50080-af6b-49da-bfe0-35d4bf739b6c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:59.741541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf50080-af6b-49da-bfe0-35d4bf739b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:59.742234 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeeaf697e55a4a51a40494aca705fb68'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.752291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeeaf697e55a4a51a40494aca705fb68'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:56:59.761287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-9bf50080-af6b-49da-bfe0-35d4bf739b6c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:56:59.763480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9bf50080-af6b-49da-bfe0-35d4bf739b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:59.768674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1285/2575] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:56:59 2022] DELETE /identity/v3/users/aeeaf697e55a4a51a40494aca705fb68 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:56:59.833367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1291/2576] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:56:59.844547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:56:59.846510 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:56:59.921807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4309457-1abf-44f1-be51-6d4db591a223 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:56:59.937795 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfe408-1897-435f-a7ea-0aa9c05a57ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:56:59.938578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfe408-1897-435f-a7ea-0aa9c05a57ec service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:56:59.939257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfe408-1897-435f-a7ea-0aa9c05a57ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:56:59.939257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfe408-1897-435f-a7ea-0aa9c05a57ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:56:59.950029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfe408-1897-435f-a7ea-0aa9c05a57ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:56:59.952090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfe408-1897-435f-a7ea-0aa9c05a57ec service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:56:59.964602 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1286/2577] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:00.366917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf50080-af6b-49da-bfe0-35d4bf739b6c None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:00.369698 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9bf50080-af6b-49da-bfe0-35d4bf739b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:00.383008 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf50080-af6b-49da-bfe0-35d4bf739b6c None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:00.388161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:00.389221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:00.389506 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:00.389779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] PATH_INFO: `/v3/projects/91a94660231c42e38aea36cd66e25136` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:00.391138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a94660231c42e38aea36cd66e25136)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:00.393653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:00.463977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a94660231c42e38aea36cd66e25136', 'request_id': 'req-e674997e-13c0-45b9-8d55-5fcb84a0567d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.471755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a94660231c42e38aea36cd66e25136', 'request_id': 'req-e674997e-13c0-45b9-8d55-5fcb84a0567d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.482712 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a94660231c42e38aea36cd66e25136', 'request_id': 'req-e674997e-13c0-45b9-8d55-5fcb84a0567d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.502903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] The token cache is being invalidate because project 91a94660231c42e38aea36cd66e25136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:00.503242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.504057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.505828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1292/2578] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:00 2022] DELETE /identity/v3/projects/91a94660231c42e38aea36cd66e25136 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:00.510737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428588-c765-4b87-94c1-4287393fa717 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:00.511342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428588-c765-4b87-94c1-4287393fa717 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:00.511621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428588-c765-4b87-94c1-4287393fa717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:00.531685 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:00.533255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:00.539378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4d428588-c765-4b87-94c1-4287393fa717 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:00.548862 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4d428588-c765-4b87-94c1-4287393fa717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:00.620973 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674997e-13c0-45b9-8d55-5fcb84a0567d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:00.625870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:00.626763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:00.627140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:00.627406 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] PATH_INFO: `/v3/projects/4b5c01d20af241a69c422ee0e62a9479` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:00.631791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5c01d20af241a69c422ee0e62a9479)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:00.633499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:00.633667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1287/2579] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:00.643003 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce621b0-763e-4180-bdb6-55d4cac77001 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:00.644371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce621b0-763e-4180-bdb6-55d4cac77001 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:00.645080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce621b0-763e-4180-bdb6-55d4cac77001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:00.672073 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-5ce621b0-763e-4180-bdb6-55d4cac77001 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:00.674550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5ce621b0-763e-4180-bdb6-55d4cac77001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:00.690525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1288/2580] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:00.690525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce621b0-763e-4180-bdb6-55d4cac77001 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:00.692829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5ce621b0-763e-4180-bdb6-55d4cac77001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:00.707229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5c01d20af241a69c422ee0e62a9479', 'request_id': 'req-95f7161f-410b-445a-acad-6d0af756fc8b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.707649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce621b0-763e-4180-bdb6-55d4cac77001 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:00.714695 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5c01d20af241a69c422ee0e62a9479', 'request_id': 'req-95f7161f-410b-445a-acad-6d0af756fc8b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.726271 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5c01d20af241a69c422ee0e62a9479', 'request_id': 'req-95f7161f-410b-445a-acad-6d0af756fc8b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.738131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] The token cache is being invalidate because project 4b5c01d20af241a69c422ee0e62a9479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:00.738414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.739085 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.744401 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1293/2581] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:00 2022] DELETE /identity/v3/projects/4b5c01d20af241a69c422ee0e62a9479 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:00.744401 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:00.744401 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:00.780515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ecd7e-5cfe-490e-8b10-4c9c60f27624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:00.781271 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ecd7e-5cfe-490e-8b10-4c9c60f27624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:00.781397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ecd7e-5cfe-490e-8b10-4c9c60f27624 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:00.781588 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ecd7e-5cfe-490e-8b10-4c9c60f27624 admin admin] PATH_INFO: `/v3/users/a9fa52cfeee64926992b781bf53a292c` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:00.782810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ecd7e-5cfe-490e-8b10-4c9c60f27624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fa52cfeee64926992b781bf53a292c)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:00.785582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ecd7e-5cfe-490e-8b10-4c9c60f27624 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:00.810924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7161f-410b-445a-acad-6d0af756fc8b admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:00.817188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b403df6-9858-4eb6-9f7b-9e6abd8951fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:00.818023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b403df6-9858-4eb6-9f7b-9e6abd8951fc admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:00.818311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b403df6-9858-4eb6-9f7b-9e6abd8951fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:00.818601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b403df6-9858-4eb6-9f7b-9e6abd8951fc admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:00.819336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b403df6-9858-4eb6-9f7b-9e6abd8951fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:00.819644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b403df6-9858-4eb6-9f7b-9e6abd8951fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:00.821309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b403df6-9858-4eb6-9f7b-9e6abd8951fc admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:00.837533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1294/2582] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:57:00.837533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414799ef-e54b-4203-98ff-7b3e18fdec54 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:00.837533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414799ef-e54b-4203-98ff-7b3e18fdec54 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:00.837533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414799ef-e54b-4203-98ff-7b3e18fdec54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:00.839648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f41ecd7e-5cfe-490e-8b10-4c9c60f27624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fa52cfeee64926992b781bf53a292c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.853222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f41ecd7e-5cfe-490e-8b10-4c9c60f27624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fa52cfeee64926992b781bf53a292c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.853953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f41ecd7e-5cfe-490e-8b10-4c9c60f27624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fa52cfeee64926992b781bf53a292c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.854565 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f41ecd7e-5cfe-490e-8b10-4c9c60f27624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fa52cfeee64926992b781bf53a292c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.856448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-414799ef-e54b-4203-98ff-7b3e18fdec54 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:00.857668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-414799ef-e54b-4203-98ff-7b3e18fdec54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:00.868867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1295/2583] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:00.869728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414799ef-e54b-4203-98ff-7b3e18fdec54 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:00.870590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f41ecd7e-5cfe-490e-8b10-4c9c60f27624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fa52cfeee64926992b781bf53a292c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:00.876952 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-414799ef-e54b-4203-98ff-7b3e18fdec54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:00.885835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1289/2584] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:00 2022] DELETE /identity/v3/users/a9fa52cfeee64926992b781bf53a292c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:00.887487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8322-c9f3-42a3-a4ac-9de85f9bb773 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:00.887614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8322-c9f3-42a3-a4ac-9de85f9bb773 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:00.887998 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a8322-c9f3-42a3-a4ac-9de85f9bb773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:00.893787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414799ef-e54b-4203-98ff-7b3e18fdec54 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:00.910094 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-399a8322-c9f3-42a3-a4ac-9de85f9bb773 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:00.911964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-399a8322-c9f3-42a3-a4ac-9de85f9bb773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:00.954638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6098c46-669b-41e4-b726-972180b4e62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:00.956203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6098c46-669b-41e4-b726-972180b4e62d admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:00.956501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6098c46-669b-41e4-b726-972180b4e62d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:00.956771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6098c46-669b-41e4-b726-972180b4e62d admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:00.957498 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6098c46-669b-41e4-b726-972180b4e62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:00.959635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6098c46-669b-41e4-b726-972180b4e62d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:00.986468 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1290/2585] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:00.991200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a8322-c9f3-42a3-a4ac-9de85f9bb773 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:00.995313 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1296/2586] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:00 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:00.998083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6098c46-669b-41e4-b726-972180b4e62d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.001645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a8322-c9f3-42a3-a4ac-9de85f9bb773 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.061837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa03b06-8ed5-4212-9309-6c739956085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.062632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa03b06-8ed5-4212-9309-6c739956085d admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.062924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa03b06-8ed5-4212-9309-6c739956085d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.063200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa03b06-8ed5-4212-9309-6c739956085d admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.063983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa03b06-8ed5-4212-9309-6c739956085d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:01.064457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa03b06-8ed5-4212-9309-6c739956085d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.066882 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa03b06-8ed5-4212-9309-6c739956085d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.069517 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6098c46-669b-41e4-b726-972180b4e62d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.085631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b89cd8-b95c-42fc-9a56-4423cb15974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.086499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89cd8-b95c-42fc-9a56-4423cb15974f admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.086840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89cd8-b95c-42fc-9a56-4423cb15974f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.087185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b89cd8-b95c-42fc-9a56-4423cb15974f admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.088015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b89cd8-b95c-42fc-9a56-4423cb15974f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.090012 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b89cd8-b95c-42fc-9a56-4423cb15974f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.091269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1291/2587] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:57:01.097385 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa03b06-8ed5-4212-9309-6c739956085d admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.109964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa03b06-8ed5-4212-9309-6c739956085d admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.115046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f43e7-23fe-4154-afd0-4a12293f4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.115751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f43e7-23fe-4154-afd0-4a12293f4be6 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.116100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f43e7-23fe-4154-afd0-4a12293f4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.116810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f43e7-23fe-4154-afd0-4a12293f4be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.119373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f43e7-23fe-4154-afd0-4a12293f4be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.120668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1297/2588] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:00 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:01.121598 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f43e7-23fe-4154-afd0-4a12293f4be6 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.126138 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b89cd8-b95c-42fc-9a56-4423cb15974f admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.141349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b89cd8-b95c-42fc-9a56-4423cb15974f admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.156437 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bad89-c000-4590-9ff4-ed21f2e10979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.157314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bad89-c000-4590-9ff4-ed21f2e10979 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.158083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bad89-c000-4590-9ff4-ed21f2e10979 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.159325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bad89-c000-4590-9ff4-ed21f2e10979 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.160967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bad89-c000-4590-9ff4-ed21f2e10979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.162961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bad89-c000-4590-9ff4-ed21f2e10979 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.163462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1292/2589] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:01 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:01.164738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f43e7-23fe-4154-afd0-4a12293f4be6 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.167127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1c0f43e7-23fe-4154-afd0-4a12293f4be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:01.184705 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1298/2590] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:01.186177 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bad89-c000-4590-9ff4-ed21f2e10979 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.201110 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bad89-c000-4590-9ff4-ed21f2e10979 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.256161 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f43e7-23fe-4154-afd0-4a12293f4be6 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.262162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.263170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.263524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.263947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] PATH_INFO: `/v3/projects/748ab04f33a044bd84110077eb692b99` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.265457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] RBAC: Authorizing `identity:delete_project(project_id=748ab04f33a044bd84110077eb692b99)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.267518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.287168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8930e-12a9-4a3d-baa6-c99bbf5301fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.288007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8930e-12a9-4a3d-baa6-c99bbf5301fd admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.288364 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8930e-12a9-4a3d-baa6-c99bbf5301fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.288730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8930e-12a9-4a3d-baa6-c99bbf5301fd admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.289504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8930e-12a9-4a3d-baa6-c99bbf5301fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.291617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8930e-12a9-4a3d-baa6-c99bbf5301fd admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.319049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1299/2591] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:01 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:01.319862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8930e-12a9-4a3d-baa6-c99bbf5301fd admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.334936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8930e-12a9-4a3d-baa6-c99bbf5301fd admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.337323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748ab04f33a044bd84110077eb692b99', 'request_id': 'req-bc73277e-89ab-44f5-b988-70c4fc9d459c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:01.344896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748ab04f33a044bd84110077eb692b99', 'request_id': 'req-bc73277e-89ab-44f5-b988-70c4fc9d459c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:01.353061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748ab04f33a044bd84110077eb692b99', 'request_id': 'req-bc73277e-89ab-44f5-b988-70c4fc9d459c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:01.365572 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] The token cache is being invalidate because project 748ab04f33a044bd84110077eb692b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:01.365886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:01.366576 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:01.368604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1293/2592] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:01 2022] DELETE /identity/v3/projects/748ab04f33a044bd84110077eb692b99 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:01.369501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.371232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:01.416686 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21dc5-5a9c-4029-9547-92b61eeb2467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.418022 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21dc5-5a9c-4029-9547-92b61eeb2467 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.418306 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21dc5-5a9c-4029-9547-92b61eeb2467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.418590 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21dc5-5a9c-4029-9547-92b61eeb2467 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.419314 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add21dc5-5a9c-4029-9547-92b61eeb2467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.421176 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add21dc5-5a9c-4029-9547-92b61eeb2467 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.432831 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1300/2593] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:01.433656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21dc5-5a9c-4029-9547-92b61eeb2467 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.437413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-add21dc5-5a9c-4029-9547-92b61eeb2467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:01.454434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21dc5-5a9c-4029-9547-92b61eeb2467 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.457741 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73277e-89ab-44f5-b988-70c4fc9d459c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.465255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea839df-ea75-42bc-9403-e876f3b85ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.468143 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea839df-ea75-42bc-9403-e876f3b85ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.468599 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea839df-ea75-42bc-9403-e876f3b85ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.468878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea839df-ea75-42bc-9403-e876f3b85ae9 admin admin] PATH_INFO: `/v3/users/df6adaaeba5e4e9799be7958bf4e589b` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.470134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea839df-ea75-42bc-9403-e876f3b85ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6adaaeba5e4e9799be7958bf4e589b)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.471562 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671c57e-7f04-460c-aa52-80f09cab1ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.472079 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671c57e-7f04-460c-aa52-80f09cab1ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.472244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea839df-ea75-42bc-9403-e876f3b85ae9 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.472368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671c57e-7f04-460c-aa52-80f09cab1ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.472637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671c57e-7f04-460c-aa52-80f09cab1ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.473383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671c57e-7f04-460c-aa52-80f09cab1ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.475153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671c57e-7f04-460c-aa52-80f09cab1ff4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.489524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1294/2594] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:01.489524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671c57e-7f04-460c-aa52-80f09cab1ff4 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.489524 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e671c57e-7f04-460c-aa52-80f09cab1ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:01.503923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671c57e-7f04-460c-aa52-80f09cab1ff4 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.509680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbcad8-c3b1-4553-b0d9-7edaf08d1414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.510614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbcad8-c3b1-4553-b0d9-7edaf08d1414 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.511020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbcad8-c3b1-4553-b0d9-7edaf08d1414 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.511342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbcad8-c3b1-4553-b0d9-7edaf08d1414 admin admin] PATH_INFO: `/v3/projects/b4275fd750454ef18631364f92a82a35/users/04162c8dacd645f5a70ad9a889948747/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.528132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fea839df-ea75-42bc-9403-e876f3b85ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6adaaeba5e4e9799be7958bf4e589b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:01.528881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbcad8-c3b1-4553-b0d9-7edaf08d1414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4275fd750454ef18631364f92a82a35, user_id=04162c8dacd645f5a70ad9a889948747, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.531644 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbcad8-c3b1-4553-b0d9-7edaf08d1414 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.545566 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fea839df-ea75-42bc-9403-e876f3b85ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6adaaeba5e4e9799be7958bf4e589b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:01.546306 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fea839df-ea75-42bc-9403-e876f3b85ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6adaaeba5e4e9799be7958bf4e589b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:01.553482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1295/2595] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:01 2022] PUT /identity/v3/projects/b4275fd750454ef18631364f92a82a35/users/04162c8dacd645f5a70ad9a889948747/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:01.554700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbcad8-c3b1-4553-b0d9-7edaf08d1414 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.561310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fea839df-ea75-42bc-9403-e876f3b85ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6adaaeba5e4e9799be7958bf4e589b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:01.572415 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-fea839df-ea75-42bc-9403-e876f3b85ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6adaaeba5e4e9799be7958bf4e589b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:01.579789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1301/2596] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:01 2022] DELETE /identity/v3/users/df6adaaeba5e4e9799be7958bf4e589b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:01.581953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d8ae9-6e47-49f8-acd5-16033ac04b28 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.582380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d8ae9-6e47-49f8-acd5-16033ac04b28 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.582701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d8ae9-6e47-49f8-acd5-16033ac04b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.621237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-b20d8ae9-6e47-49f8-acd5-16033ac04b28 None None] MFA Rules not processed for user `04162c8dacd645f5a70ad9a889948747`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:01.622546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b20d8ae9-6e47-49f8-acd5-16033ac04b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:01.654726 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbcad8-c3b1-4553-b0d9-7edaf08d1414 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.705130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1302/2597] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:01.710214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d8ae9-6e47-49f8-acd5-16033ac04b28 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.711625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b20d8ae9-6e47-49f8-acd5-16033ac04b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:01.727554 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8e765-7e6b-41e1-9bef-b665883d8532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.728307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e765-7e6b-41e1-9bef-b665883d8532 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.728594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e765-7e6b-41e1-9bef-b665883d8532 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.728874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e765-7e6b-41e1-9bef-b665883d8532 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.729621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8e765-7e6b-41e1-9bef-b665883d8532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.731246 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8e765-7e6b-41e1-9bef-b665883d8532 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.747965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1296/2598] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:01.749076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8e765-7e6b-41e1-9bef-b665883d8532 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.752095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-8ce8e765-7e6b-41e1-9bef-b665883d8532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:01.769796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8e765-7e6b-41e1-9bef-b665883d8532 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.775326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8486edc-b646-4335-8b9d-27044a382fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.776414 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8486edc-b646-4335-8b9d-27044a382fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.776697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8486edc-b646-4335-8b9d-27044a382fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.776981 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8486edc-b646-4335-8b9d-27044a382fcc admin admin] PATH_INFO: `/v3/projects/99efa7c9f2a64950bf0b8c72bb202015/users/1fb382e0d42248c2b38c415c369d2e73/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.795495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8486edc-b646-4335-8b9d-27044a382fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=99efa7c9f2a64950bf0b8c72bb202015, user_id=1fb382e0d42248c2b38c415c369d2e73, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.799135 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8486edc-b646-4335-8b9d-27044a382fcc admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.802006 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d8ae9-6e47-49f8-acd5-16033ac04b28 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.814617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527f6b5-3f3e-45bb-a809-4da1d5bc5a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.815492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527f6b5-3f3e-45bb-a809-4da1d5bc5a4d admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.815806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527f6b5-3f3e-45bb-a809-4da1d5bc5a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.816160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527f6b5-3f3e-45bb-a809-4da1d5bc5a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.816882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527f6b5-3f3e-45bb-a809-4da1d5bc5a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.818812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527f6b5-3f3e-45bb-a809-4da1d5bc5a4d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:01.828214 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1297/2599] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:01 2022] PUT /identity/v3/projects/99efa7c9f2a64950bf0b8c72bb202015/users/1fb382e0d42248c2b38c415c369d2e73/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:01.828214 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8486edc-b646-4335-8b9d-27044a382fcc admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.832926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f8486edc-b646-4335-8b9d-27044a382fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:01.855248 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1303/2600] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:01 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:01.856590 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42933897-3d87-4357-924e-942d34033807 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.856876 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42933897-3d87-4357-924e-942d34033807 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.857152 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42933897-3d87-4357-924e-942d34033807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.884853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-42933897-3d87-4357-924e-942d34033807 None None] MFA Rules not processed for user `1fb382e0d42248c2b38c415c369d2e73`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:01.886121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-42933897-3d87-4357-924e-942d34033807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:01.913696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8486edc-b646-4335-8b9d-27044a382fcc admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:01.962271 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1304/2601] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:01.963142 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42933897-3d87-4357-924e-942d34033807 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:01.982140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:01.983068 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:01.984045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:01.984045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] PATH_INFO: `/v3/projects/1892f4691c3e4ec9a1f0c967761d51f5` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:01.985176 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1892f4691c3e4ec9a1f0c967761d51f5)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:01.987673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.040095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1892f4691c3e4ec9a1f0c967761d51f5', 'request_id': 'req-5428effb-822b-43c4-9694-6aab0b413c5f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:02.041634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42933897-3d87-4357-924e-942d34033807 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.046279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1892f4691c3e4ec9a1f0c967761d51f5', 'request_id': 'req-5428effb-822b-43c4-9694-6aab0b413c5f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:02.056233 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1892f4691c3e4ec9a1f0c967761d51f5', 'request_id': 'req-5428effb-822b-43c4-9694-6aab0b413c5f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:02.067978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] The token cache is being invalidate because project 1892f4691c3e4ec9a1f0c967761d51f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:02.068266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:02.069199 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:02.071043 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1298/2602] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:01 2022] DELETE /identity/v3/projects/1892f4691c3e4ec9a1f0c967761d51f5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:02.071281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.073032 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:02.101644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b456e-e0dd-4c77-ac68-d8f180e20ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.102239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b456e-e0dd-4c77-ac68-d8f180e20ffe admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.102523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b456e-e0dd-4c77-ac68-d8f180e20ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.102799 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b456e-e0dd-4c77-ac68-d8f180e20ffe admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.103571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b456e-e0dd-4c77-ac68-d8f180e20ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.105549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b456e-e0dd-4c77-ac68-d8f180e20ffe admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.125893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1305/2603] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:01 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:02.125893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828ae7b-75b0-4975-b460-b6eb66fd4864 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.125893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828ae7b-75b0-4975-b460-b6eb66fd4864 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.125893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828ae7b-75b0-4975-b460-b6eb66fd4864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.143061 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428effb-822b-43c4-9694-6aab0b413c5f admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.146633 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-6828ae7b-75b0-4975-b460-b6eb66fd4864 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:02.147884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-6828ae7b-75b0-4975-b460-b6eb66fd4864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:02.148089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba0653-3b13-4eb4-93ba-b2971547ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.148758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba0653-3b13-4eb4-93ba-b2971547ba1a admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.149040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba0653-3b13-4eb4-93ba-b2971547ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.149323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba0653-3b13-4eb4-93ba-b2971547ba1a admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.150020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba0653-3b13-4eb4-93ba-b2971547ba1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.152459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba0653-3b13-4eb4-93ba-b2971547ba1a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.157267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1306/2604] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:02.158244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828ae7b-75b0-4975-b460-b6eb66fd4864 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.160543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-6828ae7b-75b0-4975-b460-b6eb66fd4864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:02.175665 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828ae7b-75b0-4975-b460-b6eb66fd4864 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.180354 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c8bf0-6ae5-444b-bd3b-301e8751e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.180981 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1299/2605] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:02 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:02.181134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8bf0-6ae5-444b-bd3b-301e8751e51a admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.181516 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8bf0-6ae5-444b-bd3b-301e8751e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.181797 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8bf0-6ae5-444b-bd3b-301e8751e51a admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.182298 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c1acd-11b2-44f6-bfa7-463d5bc96231 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.182537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c8bf0-6ae5-444b-bd3b-301e8751e51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.182686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c1acd-11b2-44f6-bfa7-463d5bc96231 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.182917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c1acd-11b2-44f6-bfa7-463d5bc96231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.184243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c8bf0-6ae5-444b-bd3b-301e8751e51a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.198854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1307/2606] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:02.198854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c8bf0-6ae5-444b-bd3b-301e8751e51a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.201930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-969c1acd-11b2-44f6-bfa7-463d5bc96231 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:02.203262 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-969c1acd-11b2-44f6-bfa7-463d5bc96231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:02.207797 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c8bf0-6ae5-444b-bd3b-301e8751e51a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.267689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1300/2607] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:02.269655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c1acd-11b2-44f6-bfa7-463d5bc96231 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.280043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0273b32-54b1-4cb6-acf2-0f3a4563929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.280430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c1acd-11b2-44f6-bfa7-463d5bc96231 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.280798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0273b32-54b1-4cb6-acf2-0f3a4563929e admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.281145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0273b32-54b1-4cb6-acf2-0f3a4563929e admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.281461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0273b32-54b1-4cb6-acf2-0f3a4563929e admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.282107 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0273b32-54b1-4cb6-acf2-0f3a4563929e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.285565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0273b32-54b1-4cb6-acf2-0f3a4563929e admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.287177 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e716b04-cf13-4e2a-a504-3e1e70ddb97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.288608 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e716b04-cf13-4e2a-a504-3e1e70ddb97e admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.289066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e716b04-cf13-4e2a-a504-3e1e70ddb97e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.289494 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e716b04-cf13-4e2a-a504-3e1e70ddb97e admin admin] PATH_INFO: `/v3/projects/a23de90771fd4fdc86c82d2bcfe7b199/users/c67f8a6781f246d69a09f76d8fe2e214/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.311834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1308/2608] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:02 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:02.311834 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0273b32-54b1-4cb6-acf2-0f3a4563929e admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.313659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e716b04-cf13-4e2a-a504-3e1e70ddb97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23de90771fd4fdc86c82d2bcfe7b199, user_id=c67f8a6781f246d69a09f76d8fe2e214, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.316885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e716b04-cf13-4e2a-a504-3e1e70ddb97e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.324105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0273b32-54b1-4cb6-acf2-0f3a4563929e admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.329377 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a035838-47a5-4546-8b5c-a2b04e62c4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.330078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a035838-47a5-4546-8b5c-a2b04e62c4bd admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.330367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a035838-47a5-4546-8b5c-a2b04e62c4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.331263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a035838-47a5-4546-8b5c-a2b04e62c4bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.332221 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a035838-47a5-4546-8b5c-a2b04e62c4bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:02.332543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a035838-47a5-4546-8b5c-a2b04e62c4bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.334463 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a035838-47a5-4546-8b5c-a2b04e62c4bd admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.337348 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1301/2609] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:02 2022] PUT /identity/v3/projects/a23de90771fd4fdc86c82d2bcfe7b199/users/c67f8a6781f246d69a09f76d8fe2e214/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:02.338191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e716b04-cf13-4e2a-a504-3e1e70ddb97e admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.355080 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1309/2610] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:57:02.356773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a035838-47a5-4546-8b5c-a2b04e62c4bd admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.374556 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a035838-47a5-4546-8b5c-a2b04e62c4bd admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.400937 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e716b04-cf13-4e2a-a504-3e1e70ddb97e admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.406000 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f265b-4b44-4ec4-ae78-d4f8edee590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.406708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f265b-4b44-4ec4-ae78-d4f8edee590c admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.406997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f265b-4b44-4ec4-ae78-d4f8edee590c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.407278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f265b-4b44-4ec4-ae78-d4f8edee590c admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.408055 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f265b-4b44-4ec4-ae78-d4f8edee590c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.409706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f265b-4b44-4ec4-ae78-d4f8edee590c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.422765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1302/2611] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:02.422765 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f265b-4b44-4ec4-ae78-d4f8edee590c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.433106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f265b-4b44-4ec4-ae78-d4f8edee590c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.441842 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658f2e-c1c6-4303-b6da-aa51a9fbe184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.442509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658f2e-c1c6-4303-b6da-aa51a9fbe184 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.442871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658f2e-c1c6-4303-b6da-aa51a9fbe184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.443058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658f2e-c1c6-4303-b6da-aa51a9fbe184 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.444110 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64658f2e-c1c6-4303-b6da-aa51a9fbe184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.445956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64658f2e-c1c6-4303-b6da-aa51a9fbe184 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.453897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6873301-442f-4358-b53e-d16a314a5dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.455095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873301-442f-4358-b53e-d16a314a5dcf admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.456563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873301-442f-4358-b53e-d16a314a5dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.456864 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873301-442f-4358-b53e-d16a314a5dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.457730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6873301-442f-4358-b53e-d16a314a5dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.459742 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6873301-442f-4358-b53e-d16a314a5dcf admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.474601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1310/2612] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:02.474601 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6873301-442f-4358-b53e-d16a314a5dcf admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.477238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1303/2613] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:02 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:02.478057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658f2e-c1c6-4303-b6da-aa51a9fbe184 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.484565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6873301-442f-4358-b53e-d16a314a5dcf admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.539624 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658f2e-c1c6-4303-b6da-aa51a9fbe184 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.540625 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcde9bd-0ac4-4955-9588-c39b8d954a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.541299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcde9bd-0ac4-4955-9588-c39b8d954a9a admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.541583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcde9bd-0ac4-4955-9588-c39b8d954a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.541858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcde9bd-0ac4-4955-9588-c39b8d954a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.542586 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcde9bd-0ac4-4955-9588-c39b8d954a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.544231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcde9bd-0ac4-4955-9588-c39b8d954a9a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.544781 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a55e7d-be20-4f31-8bce-36af982a7ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.545677 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a55e7d-be20-4f31-8bce-36af982a7ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.545961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a55e7d-be20-4f31-8bce-36af982a7ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.546238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a55e7d-be20-4f31-8bce-36af982a7ebf admin admin] PATH_INFO: `/v3/projects/a23de90771fd4fdc86c82d2bcfe7b199/users/c67f8a6781f246d69a09f76d8fe2e214/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.548370 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a55e7d-be20-4f31-8bce-36af982a7ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23de90771fd4fdc86c82d2bcfe7b199, user_id=c67f8a6781f246d69a09f76d8fe2e214, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.553706 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a55e7d-be20-4f31-8bce-36af982a7ebf admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.558331 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1311/2614] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:02.559774 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcde9bd-0ac4-4955-9588-c39b8d954a9a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.573864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1304/2615] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:02 2022] PUT /identity/v3/projects/a23de90771fd4fdc86c82d2bcfe7b199/users/c67f8a6781f246d69a09f76d8fe2e214/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:02.574968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a55e7d-be20-4f31-8bce-36af982a7ebf admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.577159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcde9bd-0ac4-4955-9588-c39b8d954a9a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.638688 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d3ae0-4d13-4177-9a7c-bb963fcf42a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.639398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3ae0-4d13-4177-9a7c-bb963fcf42a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.639680 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3ae0-4d13-4177-9a7c-bb963fcf42a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.639988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3ae0-4d13-4177-9a7c-bb963fcf42a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.640681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d3ae0-4d13-4177-9a7c-bb963fcf42a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.642428 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a55e7d-be20-4f31-8bce-36af982a7ebf admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.642599 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d3ae0-4d13-4177-9a7c-bb963fcf42a8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.647459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a89c49-1371-42e4-9d3e-90ea5995eefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.648504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a89c49-1371-42e4-9d3e-90ea5995eefb admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.648789 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a89c49-1371-42e4-9d3e-90ea5995eefb admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.649193 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a89c49-1371-42e4-9d3e-90ea5995eefb admin admin] PATH_INFO: `/v3/projects/57d19ea1b3e14a21b992ceba3156698d/users/eaee58b7b5ef464091554ef2c8636cbf/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.665727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a89c49-1371-42e4-9d3e-90ea5995eefb admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d19ea1b3e14a21b992ceba3156698d, user_id=eaee58b7b5ef464091554ef2c8636cbf, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.667242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1312/2616] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:02 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:02.668511 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a89c49-1371-42e4-9d3e-90ea5995eefb admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.669690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf47879-4861-405b-8b26-5fcd74699494 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.669985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf47879-4861-405b-8b26-5fcd74699494 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.670265 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf47879-4861-405b-8b26-5fcd74699494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.685093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1305/2617] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:02 2022] PUT /identity/v3/projects/57d19ea1b3e14a21b992ceba3156698d/users/eaee58b7b5ef464091554ef2c8636cbf/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:02.693855 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a89c49-1371-42e4-9d3e-90ea5995eefb admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.704585 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-baf47879-4861-405b-8b26-5fcd74699494 None None] MFA Rules not processed for user `c67f8a6781f246d69a09f76d8fe2e214`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:02.706026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-baf47879-4861-405b-8b26-5fcd74699494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:02.760747 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a89c49-1371-42e4-9d3e-90ea5995eefb admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.765713 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fe1c8-48ce-4638-9605-c92d3915732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.766395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fe1c8-48ce-4638-9605-c92d3915732d admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.766679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fe1c8-48ce-4638-9605-c92d3915732d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.766961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fe1c8-48ce-4638-9605-c92d3915732d admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.767700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fe1c8-48ce-4638-9605-c92d3915732d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.769638 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fe1c8-48ce-4638-9605-c92d3915732d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.783199 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1306/2618] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:02.783438 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1313/2619] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:02.783544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352528d-f0a1-4c57-87db-a224d87618d4 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.783544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352528d-f0a1-4c57-87db-a224d87618d4 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.783544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352528d-f0a1-4c57-87db-a224d87618d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.785997 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf47879-4861-405b-8b26-5fcd74699494 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.797534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf47879-4861-405b-8b26-5fcd74699494 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.803151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36c3e4-d947-47c8-8a3b-18bf0bc630c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.804005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36c3e4-d947-47c8-8a3b-18bf0bc630c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.804288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36c3e4-d947-47c8-8a3b-18bf0bc630c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.804562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36c3e4-d947-47c8-8a3b-18bf0bc630c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.805303 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36c3e4-d947-47c8-8a3b-18bf0bc630c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.806958 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36c3e4-d947-47c8-8a3b-18bf0bc630c9 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.813637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-f352528d-f0a1-4c57-87db-a224d87618d4 None None] MFA Rules not processed for user `eaee58b7b5ef464091554ef2c8636cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:02.814563 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f352528d-f0a1-4c57-87db-a224d87618d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:02.818904 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1314/2620] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:02.819697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36c3e4-d947-47c8-8a3b-18bf0bc630c9 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.821468 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8f36c3e4-d947-47c8-8a3b-18bf0bc630c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:02.890784 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36c3e4-d947-47c8-8a3b-18bf0bc630c9 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.894681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad1c22-d7de-49ee-b963-ace85968585f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.895335 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad1c22-d7de-49ee-b963-ace85968585f service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.895614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad1c22-d7de-49ee-b963-ace85968585f service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.895919 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad1c22-d7de-49ee-b963-ace85968585f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.902697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1307/2621] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:02.903943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352528d-f0a1-4c57-87db-a224d87618d4 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.911200 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad1c22-d7de-49ee-b963-ace85968585f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.912690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad1c22-d7de-49ee-b963-ace85968585f service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.919165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352528d-f0a1-4c57-87db-a224d87618d4 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.923602 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1315/2622] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:02.925265 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad1c22-d7de-49ee-b963-ace85968585f service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:02.928523 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828547fc-d673-42a1-9f72-da5fc366fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.929506 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828547fc-d673-42a1-9f72-da5fc366fcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.929792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828547fc-d673-42a1-9f72-da5fc366fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.930217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828547fc-d673-42a1-9f72-da5fc366fcdb admin admin] PATH_INFO: `/v3/projects/59dd987cbda9438f9279dd6c3ef7d2af/users/96c7b0c01c8d4cf5b15fc4b36c7e876c/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.944563 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad1c22-d7de-49ee-b963-ace85968585f service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:02.948040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828547fc-d673-42a1-9f72-da5fc366fcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=59dd987cbda9438f9279dd6c3ef7d2af, user_id=96c7b0c01c8d4cf5b15fc4b36c7e876c, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.949893 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46ba1e-a38e-4f29-b0b0-a48a5e8619f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:02.950654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46ba1e-a38e-4f29-b0b0-a48a5e8619f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.950940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46ba1e-a38e-4f29-b0b0-a48a5e8619f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.951220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46ba1e-a38e-4f29-b0b0-a48a5e8619f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.951963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46ba1e-a38e-4f29-b0b0-a48a5e8619f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:02.952716 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828547fc-d673-42a1-9f72-da5fc366fcdb admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.953892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46ba1e-a38e-4f29-b0b0-a48a5e8619f6 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:02.972963 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1308/2623] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:02 2022] PUT /identity/v3/projects/59dd987cbda9438f9279dd6c3ef7d2af/users/96c7b0c01c8d4cf5b15fc4b36c7e876c/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:02.984247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94be39-702a-4421-bcbe-8f2e6430aae1 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:02.984627 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94be39-702a-4421-bcbe-8f2e6430aae1 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:02.984844 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94be39-702a-4421-bcbe-8f2e6430aae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:02.995986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1316/2624] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:02 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:03.000709 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46ba1e-a38e-4f29-b0b0-a48a5e8619f6 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.021155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-ed94be39-702a-4421-bcbe-8f2e6430aae1 None None] MFA Rules not processed for user `96c7b0c01c8d4cf5b15fc4b36c7e876c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:03.023063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ed94be39-702a-4421-bcbe-8f2e6430aae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:03.098093 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46ba1e-a38e-4f29-b0b0-a48a5e8619f6 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.102878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede841-fd37-4bb2-9ba1-ca552871400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.103587 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede841-fd37-4bb2-9ba1-ca552871400d admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.103900 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede841-fd37-4bb2-9ba1-ca552871400d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.104185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede841-fd37-4bb2-9ba1-ca552871400d admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.104903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ede841-fd37-4bb2-9ba1-ca552871400d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.106853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ede841-fd37-4bb2-9ba1-ca552871400d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.114689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1309/2625] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:57:03.115350 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94be39-702a-4421-bcbe-8f2e6430aae1 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.135214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1317/2626] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:02 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:03.135214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede841-fd37-4bb2-9ba1-ca552871400d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.148012 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede841-fd37-4bb2-9ba1-ca552871400d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.153054 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a86e1-684c-4712-8e89-20ccc31179cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.153723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a86e1-684c-4712-8e89-20ccc31179cb admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.154002 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a86e1-684c-4712-8e89-20ccc31179cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.154655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a86e1-684c-4712-8e89-20ccc31179cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.154971 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a86e1-684c-4712-8e89-20ccc31179cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.157024 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a86e1-684c-4712-8e89-20ccc31179cb admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.176869 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94be39-702a-4421-bcbe-8f2e6430aae1 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.180774 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8dfc8-7885-446a-b55b-a7e434753b05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.181515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8dfc8-7885-446a-b55b-a7e434753b05 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.181719 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8dfc8-7885-446a-b55b-a7e434753b05 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.181996 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8dfc8-7885-446a-b55b-a7e434753b05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.184502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0ad8dfc8-7885-446a-b55b-a7e434753b05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:03.184638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1318/2627] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:03 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:03.185642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a86e1-684c-4712-8e89-20ccc31179cb admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.256336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a86e1-684c-4712-8e89-20ccc31179cb admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.256639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8dfc8-7885-446a-b55b-a7e434753b05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.258890 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8dfc8-7885-446a-b55b-a7e434753b05 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.261634 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff6a02-40fa-43c6-acc5-37cd69406715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.262596 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6a02-40fa-43c6-acc5-37cd69406715 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.262880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6a02-40fa-43c6-acc5-37cd69406715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.263168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6a02-40fa-43c6-acc5-37cd69406715 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.263964 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff6a02-40fa-43c6-acc5-37cd69406715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.265591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff6a02-40fa-43c6-acc5-37cd69406715 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.269828 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1310/2628] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:03.270764 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8dfc8-7885-446a-b55b-a7e434753b05 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.278117 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1319/2629] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:03.282168 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff6a02-40fa-43c6-acc5-37cd69406715 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.282674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8dfc8-7885-446a-b55b-a7e434753b05 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.288126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f82ee-cb96-43fa-af4e-84e88873faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.288814 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f82ee-cb96-43fa-af4e-84e88873faf3 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.289097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f82ee-cb96-43fa-af4e-84e88873faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.289375 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f82ee-cb96-43fa-af4e-84e88873faf3 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.290338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f82ee-cb96-43fa-af4e-84e88873faf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.293121 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f82ee-cb96-43fa-af4e-84e88873faf3 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.295041 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff6a02-40fa-43c6-acc5-37cd69406715 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.300542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f066b-d1d0-427b-aef6-a928babc633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.301905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f066b-d1d0-427b-aef6-a928babc633a admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.301905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f066b-d1d0-427b-aef6-a928babc633a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.302218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f066b-d1d0-427b-aef6-a928babc633a admin admin] PATH_INFO: `/v3/projects/721ba84dc1884d28a889d27c5a6dc660/users/e2adda16d4294bed989b17645c3a5519/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.322701 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1311/2630] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:03 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:03.322920 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f066b-d1d0-427b-aef6-a928babc633a admin admin] RBAC: Authorizing `identity:create_grant(project_id=721ba84dc1884d28a889d27c5a6dc660, user_id=e2adda16d4294bed989b17645c3a5519, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.323979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f82ee-cb96-43fa-af4e-84e88873faf3 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.324673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f066b-d1d0-427b-aef6-a928babc633a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.335803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f82ee-cb96-43fa-af4e-84e88873faf3 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.345333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1320/2631] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:03 2022] PUT /identity/v3/projects/721ba84dc1884d28a889d27c5a6dc660/users/e2adda16d4294bed989b17645c3a5519/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:03.347182 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f066b-d1d0-427b-aef6-a928babc633a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.417144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a469b-39ee-4244-8e13-65409a2d4ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.417825 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a469b-39ee-4244-8e13-65409a2d4ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.418108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a469b-39ee-4244-8e13-65409a2d4ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.418736 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a469b-39ee-4244-8e13-65409a2d4ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.419370 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a469b-39ee-4244-8e13-65409a2d4ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.421331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a469b-39ee-4244-8e13-65409a2d4ff9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.438438 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1312/2632] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:03.441261 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f066b-d1d0-427b-aef6-a928babc633a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.443170 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a469b-39ee-4244-8e13-65409a2d4ff9 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.450153 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59eedab-76bc-4be8-a021-d235134a311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.451397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eedab-76bc-4be8-a021-d235134a311f admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.451397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eedab-76bc-4be8-a021-d235134a311f admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.451654 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eedab-76bc-4be8-a021-d235134a311f admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.452488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59eedab-76bc-4be8-a021-d235134a311f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.454105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59eedab-76bc-4be8-a021-d235134a311f admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.456919 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a469b-39ee-4244-8e13-65409a2d4ff9 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.463896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d42c49-c7ec-40ae-9cf1-da2d4f68cb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.464892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d42c49-c7ec-40ae-9cf1-da2d4f68cb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.465185 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d42c49-c7ec-40ae-9cf1-da2d4f68cb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.465679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d42c49-c7ec-40ae-9cf1-da2d4f68cb01 admin admin] PATH_INFO: `/v3/projects/8db91ef5f0f64e79bea5df4e62bd24dd/users/1556cfae42a24596abceefa18c509bfe/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.465808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1321/2633] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:03.470066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59eedab-76bc-4be8-a021-d235134a311f admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.480282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59eedab-76bc-4be8-a021-d235134a311f admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.483583 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d42c49-c7ec-40ae-9cf1-da2d4f68cb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db91ef5f0f64e79bea5df4e62bd24dd, user_id=1556cfae42a24596abceefa18c509bfe, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.485488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b29d6-e5ad-486e-a7bf-d830c35c672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.487508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b29d6-e5ad-486e-a7bf-d830c35c672c admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.487782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d42c49-c7ec-40ae-9cf1-da2d4f68cb01 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.487883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b29d6-e5ad-486e-a7bf-d830c35c672c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.487883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b29d6-e5ad-486e-a7bf-d830c35c672c admin admin] PATH_INFO: `/v3/projects/721ba84dc1884d28a889d27c5a6dc660/users/e2adda16d4294bed989b17645c3a5519/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.490177 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b29d6-e5ad-486e-a7bf-d830c35c672c admin admin] RBAC: Authorizing `identity:create_grant(project_id=721ba84dc1884d28a889d27c5a6dc660, user_id=e2adda16d4294bed989b17645c3a5519, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.496132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b29d6-e5ad-486e-a7bf-d830c35c672c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.503758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1313/2634] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:03 2022] PUT /identity/v3/projects/8db91ef5f0f64e79bea5df4e62bd24dd/users/1556cfae42a24596abceefa18c509bfe/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:03.507752 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d42c49-c7ec-40ae-9cf1-da2d4f68cb01 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.509297 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1322/2635] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:03 2022] PUT /identity/v3/projects/721ba84dc1884d28a889d27c5a6dc660/users/e2adda16d4294bed989b17645c3a5519/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:03.521288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14132be-bf2c-45d7-b181-1adadb9f07ef None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.521667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14132be-bf2c-45d7-b181-1adadb9f07ef None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.521667 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14132be-bf2c-45d7-b181-1adadb9f07ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.553029 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-b14132be-bf2c-45d7-b181-1adadb9f07ef None None] MFA Rules not processed for user `e2adda16d4294bed989b17645c3a5519`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:03.554440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b14132be-bf2c-45d7-b181-1adadb9f07ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:03.584153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d42c49-c7ec-40ae-9cf1-da2d4f68cb01 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.635659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1323/2636] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:57:03.637056 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14132be-bf2c-45d7-b181-1adadb9f07ef None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.652229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294baba-2f59-4224-8277-71f93674b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.652830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294baba-2f59-4224-8277-71f93674b10d admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.653116 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294baba-2f59-4224-8277-71f93674b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.653395 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294baba-2f59-4224-8277-71f93674b10d admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.654140 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294baba-2f59-4224-8277-71f93674b10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.655885 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294baba-2f59-4224-8277-71f93674b10d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.667656 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1314/2637] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:57:03.672325 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294baba-2f59-4224-8277-71f93674b10d admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.702750 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14132be-bf2c-45d7-b181-1adadb9f07ef None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.708505 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.709392 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.709672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.709948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] PATH_INFO: `/v3/users/04162c8dacd645f5a70ad9a889948747` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.711337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04162c8dacd645f5a70ad9a889948747)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.713341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.732410 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294baba-2f59-4224-8277-71f93674b10d admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.736108 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777452c-7280-430e-a928-0705a4180bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.737358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777452c-7280-430e-a928-0705a4180bad service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.738154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777452c-7280-430e-a928-0705a4180bad service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.738437 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777452c-7280-430e-a928-0705a4180bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.740561 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2777452c-7280-430e-a928-0705a4180bad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:03.773249 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04162c8dacd645f5a70ad9a889948747'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:03.786551 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04162c8dacd645f5a70ad9a889948747'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:03.787323 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04162c8dacd645f5a70ad9a889948747'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:03.796129 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04162c8dacd645f5a70ad9a889948747'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:03.804573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04162c8dacd645f5a70ad9a889948747'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:03.805011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777452c-7280-430e-a928-0705a4180bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.806498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777452c-7280-430e-a928-0705a4180bad service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.810886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1324/2638] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:03 2022] DELETE /identity/v3/users/04162c8dacd645f5a70ad9a889948747 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:03.811730 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.813189 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:03.819960 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1315/2639] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:03.821479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330562b0-9694-4b8e-b958-c57dd320a225 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.821920 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330562b0-9694-4b8e-b958-c57dd320a225 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.822388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330562b0-9694-4b8e-b958-c57dd320a225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.841355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-330562b0-9694-4b8e-b958-c57dd320a225 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:03.842573 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-330562b0-9694-4b8e-b958-c57dd320a225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:03.889279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adbdb8-e8b4-4fd4-8911-746910566119 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:03.895885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099f013-591f-4120-9149-fbda8a18704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:03.896809 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099f013-591f-4120-9149-fbda8a18704a admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.897094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099f013-591f-4120-9149-fbda8a18704a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.897367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099f013-591f-4120-9149-fbda8a18704a admin admin] PATH_INFO: `/v3/projects/8db91ef5f0f64e79bea5df4e62bd24dd/users/1556cfae42a24596abceefa18c509bfe/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.899508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099f013-591f-4120-9149-fbda8a18704a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db91ef5f0f64e79bea5df4e62bd24dd, user_id=1556cfae42a24596abceefa18c509bfe, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:03.902420 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099f013-591f-4120-9149-fbda8a18704a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:03.909263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1316/2640] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:03.920378 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330562b0-9694-4b8e-b958-c57dd320a225 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:03.921790 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-330562b0-9694-4b8e-b958-c57dd320a225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:03.930233 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1325/2641] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:03 2022] PUT /identity/v3/projects/8db91ef5f0f64e79bea5df4e62bd24dd/users/1556cfae42a24596abceefa18c509bfe/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:03.938829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c02557-689e-4646-88bb-62406697cee2 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:03.939103 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c02557-689e-4646-88bb-62406697cee2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:03.939393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c02557-689e-4646-88bb-62406697cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:03.972304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a6c02557-689e-4646-88bb-62406697cee2 None None] MFA Rules not processed for user `1556cfae42a24596abceefa18c509bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:03.973630 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a6c02557-689e-4646-88bb-62406697cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:03.996237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330562b0-9694-4b8e-b958-c57dd320a225 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:04.061648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1326/2642] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:04.063600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6159a-e1b6-4d78-86a6-ac42c0a79b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:04.064703 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6159a-e1b6-4d78-86a6-ac42c0a79b74 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:04.064823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6159a-e1b6-4d78-86a6-ac42c0a79b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:04.065566 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6159a-e1b6-4d78-86a6-ac42c0a79b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:04.074813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c02557-689e-4646-88bb-62406697cee2 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:04.076072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a6c02557-689e-4646-88bb-62406697cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:04.148009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c02557-689e-4646-88bb-62406697cee2 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:04.149380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6159a-e1b6-4d78-86a6-ac42c0a79b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:04.151043 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6159a-e1b6-4d78-86a6-ac42c0a79b74 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:04.154268 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1f9e3-f40b-4424-870f-8754ba225a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:04.154849 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1f9e3-f40b-4424-870f-8754ba225a36 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:04.155133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1f9e3-f40b-4424-870f-8754ba225a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:04.155410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1f9e3-f40b-4424-870f-8754ba225a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:04.162857 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1317/2643] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:04.170579 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1f9e3-f40b-4424-870f-8754ba225a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:04.172278 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1f9e3-f40b-4424-870f-8754ba225a36 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:04.187949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1327/2644] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:57:04.508211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6159a-e1b6-4d78-86a6-ac42c0a79b74 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:04.509648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-78f6159a-e1b6-4d78-86a6-ac42c0a79b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:04.522800 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6159a-e1b6-4d78-86a6-ac42c0a79b74 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:04.532159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:04.532159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:04.532159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:04.532159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] PATH_INFO: `/v3/projects/b4275fd750454ef18631364f92a82a35` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:04.532762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4275fd750454ef18631364f92a82a35)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:04.543161 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:04.605315 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4275fd750454ef18631364f92a82a35', 'request_id': 'req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.614770 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4275fd750454ef18631364f92a82a35', 'request_id': 'req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.630311 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4275fd750454ef18631364f92a82a35', 'request_id': 'req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.646516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] The token cache is being invalidate because project b4275fd750454ef18631364f92a82a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:04.646829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.647477 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.649114 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1318/2645] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:04 2022] DELETE /identity/v3/projects/b4275fd750454ef18631364f92a82a35 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:04.653839 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1f9e3-f40b-4424-870f-8754ba225a36 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:04.666288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1f9e3-f40b-4424-870f-8754ba225a36 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:04.676286 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:04.677739 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:04.736493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1bba2-2a7c-43d4-b336-387145e095db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:04.737916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1bba2-2a7c-43d4-b336-387145e095db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:04.738190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1bba2-2a7c-43d4-b336-387145e095db admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:04.738469 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1bba2-2a7c-43d4-b336-387145e095db admin admin] PATH_INFO: `/v3/users/c67f8a6781f246d69a09f76d8fe2e214` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:04.739696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1bba2-2a7c-43d4-b336-387145e095db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67f8a6781f246d69a09f76d8fe2e214)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:04.741692 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1bba2-2a7c-43d4-b336-387145e095db admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:04.756528 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264cc18-8996-47d7-ab1f-91f49d1c5a1a admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:04.761584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:04.762478 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:04.762760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:04.763036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] PATH_INFO: `/v3/users/96c7b0c01c8d4cf5b15fc4b36c7e876c` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:04.764387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c7b0c01c8d4cf5b15fc4b36c7e876c)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:04.766333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:04.805446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-50d1bba2-2a7c-43d4-b336-387145e095db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67f8a6781f246d69a09f76d8fe2e214'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.820370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-50d1bba2-2a7c-43d4-b336-387145e095db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67f8a6781f246d69a09f76d8fe2e214'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.821052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-50d1bba2-2a7c-43d4-b336-387145e095db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67f8a6781f246d69a09f76d8fe2e214'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.833068 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-50d1bba2-2a7c-43d4-b336-387145e095db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67f8a6781f246d69a09f76d8fe2e214'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.834751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c7b0c01c8d4cf5b15fc4b36c7e876c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.843519 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-50d1bba2-2a7c-43d4-b336-387145e095db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67f8a6781f246d69a09f76d8fe2e214'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.852724 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1328/2646] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:04 2022] DELETE /identity/v3/users/c67f8a6781f246d69a09f76d8fe2e214 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:04.854251 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c7b0c01c8d4cf5b15fc4b36c7e876c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.855335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c7b0c01c8d4cf5b15fc4b36c7e876c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.856332 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c7b0c01c8d4cf5b15fc4b36c7e876c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.865866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c7b0c01c8d4cf5b15fc4b36c7e876c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:04.879405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1319/2647] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:04 2022] DELETE /identity/v3/users/96c7b0c01c8d4cf5b15fc4b36c7e876c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:04.884529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455e5bb-2ab1-46b7-bd64-5c9152fe44ae None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:04.884529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455e5bb-2ab1-46b7-bd64-5c9152fe44ae None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:04.884529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455e5bb-2ab1-46b7-bd64-5c9152fe44ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:04.902279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-4455e5bb-2ab1-46b7-bd64-5c9152fe44ae None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:04.903495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4455e5bb-2ab1-46b7-bd64-5c9152fe44ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:04.977376 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1329/2648] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:04.988964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:04.990519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:05.057412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48919206-c944-49e1-aed2-b015982f9f39 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:05.061237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6c4d4-b076-4b8a-bcf1-3796f39bf337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:05.061896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6c4d4-b076-4b8a-bcf1-3796f39bf337 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.062180 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6c4d4-b076-4b8a-bcf1-3796f39bf337 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.062575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6c4d4-b076-4b8a-bcf1-3796f39bf337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.072849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6c4d4-b076-4b8a-bcf1-3796f39bf337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:05.074301 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6c4d4-b076-4b8a-bcf1-3796f39bf337 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:05.085158 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1320/2649] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:05.198391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455e5bb-2ab1-46b7-bd64-5c9152fe44ae None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:05.199988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4455e5bb-2ab1-46b7-bd64-5c9152fe44ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:05.212400 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455e5bb-2ab1-46b7-bd64-5c9152fe44ae None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:05.218348 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:05.219343 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.219701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.220116 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] PATH_INFO: `/v3/projects/a23de90771fd4fdc86c82d2bcfe7b199` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.222165 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23de90771fd4fdc86c82d2bcfe7b199)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:05.224254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:05.276828 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23de90771fd4fdc86c82d2bcfe7b199', 'request_id': 'req-f879b30e-ead3-4076-a33f-df39ba6dd484'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.283461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23de90771fd4fdc86c82d2bcfe7b199', 'request_id': 'req-f879b30e-ead3-4076-a33f-df39ba6dd484'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.293047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23de90771fd4fdc86c82d2bcfe7b199', 'request_id': 'req-f879b30e-ead3-4076-a33f-df39ba6dd484'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.307035 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] The token cache is being invalidate because project a23de90771fd4fdc86c82d2bcfe7b199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:05.307388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.308631 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-f879b30e-ead3-4076-a33f-df39ba6dd484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.313849 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1330/2650] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:05 2022] DELETE /identity/v3/projects/a23de90771fd4fdc86c82d2bcfe7b199 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:05.315966 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92a0ee-c669-424d-a075-d381a89a7739 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.316263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92a0ee-c669-424d-a075-d381a89a7739 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.316543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92a0ee-c669-424d-a075-d381a89a7739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.337016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4f92a0ee-c669-424d-a075-d381a89a7739 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:05.338391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4f92a0ee-c669-424d-a075-d381a89a7739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:05.410380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1321/2651] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:57:05.419061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f7ea4-c14b-4a4a-8b86-37cbf47c536e None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.419516 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f7ea4-c14b-4a4a-8b86-37cbf47c536e None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.419933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f7ea4-c14b-4a4a-8b86-37cbf47c536e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.443385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-a15f7ea4-c14b-4a4a-8b86-37cbf47c536e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:05.444478 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a15f7ea4-c14b-4a4a-8b86-37cbf47c536e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:05.457309 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1331/2652] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:05.462630 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92a0ee-c669-424d-a075-d381a89a7739 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:05.474980 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92a0ee-c669-424d-a075-d381a89a7739 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:05.480983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462635-1932-4964-aa7b-c8e72297e9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:05.481772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462635-1932-4964-aa7b-c8e72297e9bd admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.482060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462635-1932-4964-aa7b-c8e72297e9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.482337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462635-1932-4964-aa7b-c8e72297e9bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.483152 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1462635-1932-4964-aa7b-c8e72297e9bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:05.483468 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1462635-1932-4964-aa7b-c8e72297e9bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:05.485119 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1462635-1932-4964-aa7b-c8e72297e9bd admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:05.490743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f7ea4-c14b-4a4a-8b86-37cbf47c536e None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:05.492642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-a15f7ea4-c14b-4a4a-8b86-37cbf47c536e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:05.498807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1322/2653] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:57:05.499664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462635-1932-4964-aa7b-c8e72297e9bd admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:05.502083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f1462635-1932-4964-aa7b-c8e72297e9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:05.507522 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f7ea4-c14b-4a4a-8b86-37cbf47c536e None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:05.513423 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:05.514306 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.514585 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.514898 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] PATH_INFO: `/v3/projects/59dd987cbda9438f9279dd6c3ef7d2af` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.516128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59dd987cbda9438f9279dd6c3ef7d2af)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:05.518580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:05.570751 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462635-1932-4964-aa7b-c8e72297e9bd admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:05.574241 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59dd987cbda9438f9279dd6c3ef7d2af', 'request_id': 'req-77c922e7-5248-4391-8940-736d56b505f8'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.581453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59dd987cbda9438f9279dd6c3ef7d2af', 'request_id': 'req-77c922e7-5248-4391-8940-736d56b505f8'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.594052 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59dd987cbda9438f9279dd6c3ef7d2af', 'request_id': 'req-77c922e7-5248-4391-8940-736d56b505f8'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.605983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] The token cache is being invalidate because project 59dd987cbda9438f9279dd6c3ef7d2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:05.606292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.606916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.608573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1332/2654] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:05 2022] DELETE /identity/v3/projects/59dd987cbda9438f9279dd6c3ef7d2af => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:05.609584 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:05.610868 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:05.620468 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7878d-cf8f-46c7-a49e-ef913dff6f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:05.621122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7878d-cf8f-46c7-a49e-ef913dff6f96 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.621404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7878d-cf8f-46c7-a49e-ef913dff6f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.621678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7878d-cf8f-46c7-a49e-ef913dff6f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.623460 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-32d7878d-cf8f-46c7-a49e-ef913dff6f96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:05.683419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c922e7-5248-4391-8940-736d56b505f8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:05.688188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694548ee-d773-4a97-8b76-ae32087affa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:05.689158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694548ee-d773-4a97-8b76-ae32087affa3 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.689158 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694548ee-d773-4a97-8b76-ae32087affa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.689706 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694548ee-d773-4a97-8b76-ae32087affa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.691406 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694548ee-d773-4a97-8b76-ae32087affa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:05.694347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7878d-cf8f-46c7-a49e-ef913dff6f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:05.694593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694548ee-d773-4a97-8b76-ae32087affa3 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:05.695791 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7878d-cf8f-46c7-a49e-ef913dff6f96 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:05.705092 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1323/2655] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:05.706615 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7878d-cf8f-46c7-a49e-ef913dff6f96 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:05.708179 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-32d7878d-cf8f-46c7-a49e-ef913dff6f96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:05.722399 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7878d-cf8f-46c7-a49e-ef913dff6f96 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:05.728147 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:05.729014 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.729291 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.730396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] PATH_INFO: `/v3/users/1556cfae42a24596abceefa18c509bfe` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.731164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1556cfae42a24596abceefa18c509bfe)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:05.733284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:05.743619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1333/2656] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:05 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:05.747573 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694548ee-d773-4a97-8b76-ae32087affa3 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:05.795471 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1556cfae42a24596abceefa18c509bfe'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.808730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1556cfae42a24596abceefa18c509bfe'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.809527 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1556cfae42a24596abceefa18c509bfe'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.810143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1556cfae42a24596abceefa18c509bfe'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.820203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694548ee-d773-4a97-8b76-ae32087affa3 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:05.824160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1556cfae42a24596abceefa18c509bfe'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:05.826565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d801afb-c7ab-4854-8cb8-02679692366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:05.827488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d801afb-c7ab-4854-8cb8-02679692366a admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.827930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d801afb-c7ab-4854-8cb8-02679692366a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.828267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d801afb-c7ab-4854-8cb8-02679692366a admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.829095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d801afb-c7ab-4854-8cb8-02679692366a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:05.831658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d801afb-c7ab-4854-8cb8-02679692366a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:05.840698 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1324/2657] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:05 2022] DELETE /identity/v3/users/1556cfae42a24596abceefa18c509bfe => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:05.857979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1334/2658] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:05 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:05.859357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:05.860821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:05.951043 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ed3a3-8eba-4580-98df-c9be28865dc9 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:05.956512 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6b4a9-c619-471d-a5ab-4b2a0fc3ab21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:05.957197 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6b4a9-c619-471d-a5ab-4b2a0fc3ab21 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.957466 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6b4a9-c619-471d-a5ab-4b2a0fc3ab21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.957746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6b4a9-c619-471d-a5ab-4b2a0fc3ab21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.958489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6b4a9-c619-471d-a5ab-4b2a0fc3ab21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:05.960142 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6b4a9-c619-471d-a5ab-4b2a0fc3ab21 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:05.974678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1325/2659] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:05.978688 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d801afb-c7ab-4854-8cb8-02679692366a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:05.991501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d801afb-c7ab-4854-8cb8-02679692366a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:05.996645 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc930a3-46a5-4c62-a5cc-96fe2c32233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:05.997547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc930a3-46a5-4c62-a5cc-96fe2c32233d admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:05.997976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc930a3-46a5-4c62-a5cc-96fe2c32233d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:05.998409 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc930a3-46a5-4c62-a5cc-96fe2c32233d admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:05.999344 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc930a3-46a5-4c62-a5cc-96fe2c32233d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:06.000988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc930a3-46a5-4c62-a5cc-96fe2c32233d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:06.014702 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1335/2660] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:06.019631 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6b4a9-c619-471d-a5ab-4b2a0fc3ab21 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:06.035516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6b4a9-c619-471d-a5ab-4b2a0fc3ab21 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:06.045128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0554ffa-bf1d-4192-a1c4-d1ba0479eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:06.046232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0554ffa-bf1d-4192-a1c4-d1ba0479eb33 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.046626 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0554ffa-bf1d-4192-a1c4-d1ba0479eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.047678 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0554ffa-bf1d-4192-a1c4-d1ba0479eb33 admin admin] PATH_INFO: `/v3/projects/2d0ec0d48e214633a80ad3b675b00038/users/c96ed3bc83aa407da115d1a79e26afd4/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.070393 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0554ffa-bf1d-4192-a1c4-d1ba0479eb33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0ec0d48e214633a80ad3b675b00038, user_id=c96ed3bc83aa407da115d1a79e26afd4, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:06.074784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0554ffa-bf1d-4192-a1c4-d1ba0479eb33 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:06.091365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1326/2661] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:06 2022] PUT /identity/v3/projects/2d0ec0d48e214633a80ad3b675b00038/users/c96ed3bc83aa407da115d1a79e26afd4/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:06.097482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b141c-6298-4e69-b163-48b1bf0eb2f6 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.097776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b141c-6298-4e69-b163-48b1bf0eb2f6 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.098237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b141c-6298-4e69-b163-48b1bf0eb2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.119359 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c74b141c-6298-4e69-b163-48b1bf0eb2f6 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:06.120856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c74b141c-6298-4e69-b163-48b1bf0eb2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:06.217302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1336/2662] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:06.220213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0554ffa-bf1d-4192-a1c4-d1ba0479eb33 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:06.223769 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-e0554ffa-bf1d-4192-a1c4-d1ba0479eb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:06.225591 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b141c-6298-4e69-b163-48b1bf0eb2f6 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:06.228151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c74b141c-6298-4e69-b163-48b1bf0eb2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:06.249107 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0554ffa-bf1d-4192-a1c4-d1ba0479eb33 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:06.260018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:06.262095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.262562 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.263164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] PATH_INFO: `/v3/projects/8db91ef5f0f64e79bea5df4e62bd24dd` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.265096 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db91ef5f0f64e79bea5df4e62bd24dd)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:06.269083 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:06.310147 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b141c-6298-4e69-b163-48b1bf0eb2f6 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:06.330117 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db91ef5f0f64e79bea5df4e62bd24dd', 'request_id': 'req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:06.337797 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db91ef5f0f64e79bea5df4e62bd24dd', 'request_id': 'req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:06.350424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db91ef5f0f64e79bea5df4e62bd24dd', 'request_id': 'req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:06.364333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] The token cache is being invalidate because project 8db91ef5f0f64e79bea5df4e62bd24dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:06.364635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:06.365326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-d3b9be36-9626-4ff2-a44b-7e6bee95cd03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:06.366988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1327/2663] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:06 2022] DELETE /identity/v3/projects/8db91ef5f0f64e79bea5df4e62bd24dd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:06.371695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020370bc-db1d-4953-b0f1-e9adc7d353aa None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.372027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020370bc-db1d-4953-b0f1-e9adc7d353aa None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.372306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020370bc-db1d-4953-b0f1-e9adc7d353aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.392567 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-020370bc-db1d-4953-b0f1-e9adc7d353aa None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:06.395051 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-020370bc-db1d-4953-b0f1-e9adc7d353aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:06.395327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158aa82-96a0-44db-a1e1-ca3a3c621ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:06.396433 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158aa82-96a0-44db-a1e1-ca3a3c621ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.396861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158aa82-96a0-44db-a1e1-ca3a3c621ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.397144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158aa82-96a0-44db-a1e1-ca3a3c621ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.398916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b158aa82-96a0-44db-a1e1-ca3a3c621ce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:06.459808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1328/2664] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:57:06.460579 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020370bc-db1d-4953-b0f1-e9adc7d353aa None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:06.461972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-020370bc-db1d-4953-b0f1-e9adc7d353aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:06.466949 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158aa82-96a0-44db-a1e1-ca3a3c621ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:06.468847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158aa82-96a0-44db-a1e1-ca3a3c621ce5 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:06.480128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1337/2665] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:06.481268 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a28271-56bd-41fd-bed2-f2064521e7a2 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.481562 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a28271-56bd-41fd-bed2-f2064521e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.481854 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a28271-56bd-41fd-bed2-f2064521e7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.500395 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-f3a28271-56bd-41fd-bed2-f2064521e7a2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:06.501813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-f3a28271-56bd-41fd-bed2-f2064521e7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:06.511439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1338/2666] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:06.515752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a28271-56bd-41fd-bed2-f2064521e7a2 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:06.526508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a28271-56bd-41fd-bed2-f2064521e7a2 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:06.529918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020370bc-db1d-4953-b0f1-e9adc7d353aa None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:06.532162 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd39d2-82d7-4611-bef6-19fc185870ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:06.532953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd39d2-82d7-4611-bef6-19fc185870ca admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.533217 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd39d2-82d7-4611-bef6-19fc185870ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.534529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd39d2-82d7-4611-bef6-19fc185870ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.534998 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd39d2-82d7-4611-bef6-19fc185870ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:06.535305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd39d2-82d7-4611-bef6-19fc185870ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:06.536449 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96205f3c-dde8-457f-a84a-3fad02580f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:06.536970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd39d2-82d7-4611-bef6-19fc185870ca admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:06.537871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205f3c-dde8-457f-a84a-3fad02580f36 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.538468 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205f3c-dde8-457f-a84a-3fad02580f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.538696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205f3c-dde8-457f-a84a-3fad02580f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.540792 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-96205f3c-dde8-457f-a84a-3fad02580f36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:06.555295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1339/2667] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:57:06.556333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd39d2-82d7-4611-bef6-19fc185870ca admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:06.566804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd39d2-82d7-4611-bef6-19fc185870ca admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:06.571910 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2177-7e8b-444d-ac8a-de70dc7a213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:06.572581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2177-7e8b-444d-ac8a-de70dc7a213c admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.572859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2177-7e8b-444d-ac8a-de70dc7a213c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.573295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2177-7e8b-444d-ac8a-de70dc7a213c admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.573845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f2177-7e8b-444d-ac8a-de70dc7a213c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:06.575787 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f2177-7e8b-444d-ac8a-de70dc7a213c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:06.609285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1340/2668] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:06 2022] POST /identity/v3/projects => generated 357 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:06.614936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2177-7e8b-444d-ac8a-de70dc7a213c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:06.635727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96205f3c-dde8-457f-a84a-3fad02580f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:06.637367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96205f3c-dde8-457f-a84a-3fad02580f36 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:06.649698 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1329/2669] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:06.686673 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2177-7e8b-444d-ac8a-de70dc7a213c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:06.692657 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9286072-f3a8-47eb-a26d-cbcc99b04247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:06.693411 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9286072-f3a8-47eb-a26d-cbcc99b04247 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.693693 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9286072-f3a8-47eb-a26d-cbcc99b04247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.694145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9286072-f3a8-47eb-a26d-cbcc99b04247 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.694857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9286072-f3a8-47eb-a26d-cbcc99b04247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:06.697206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9286072-f3a8-47eb-a26d-cbcc99b04247 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:06.726255 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1341/2670] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:06 2022] POST /identity/v3/users => generated 279 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:06.727659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96205f3c-dde8-457f-a84a-3fad02580f36 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:06.740462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96205f3c-dde8-457f-a84a-3fad02580f36 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:06.746342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46093c-f0ed-400e-b98f-c91de5a06d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:06.747331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46093c-f0ed-400e-b98f-c91de5a06d0e admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.749488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46093c-f0ed-400e-b98f-c91de5a06d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.749488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46093c-f0ed-400e-b98f-c91de5a06d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.749488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46093c-f0ed-400e-b98f-c91de5a06d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:06.750655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46093c-f0ed-400e-b98f-c91de5a06d0e admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:06.763167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1330/2671] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:57:06.767798 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9286072-f3a8-47eb-a26d-cbcc99b04247 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:06.779472 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9286072-f3a8-47eb-a26d-cbcc99b04247 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:06.784988 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973449cf-b1e2-49aa-86e5-d2c43745e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:06.785746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973449cf-b1e2-49aa-86e5-d2c43745e927 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.787664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973449cf-b1e2-49aa-86e5-d2c43745e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.787664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973449cf-b1e2-49aa-86e5-d2c43745e927 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.787664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973449cf-b1e2-49aa-86e5-d2c43745e927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:06.788751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973449cf-b1e2-49aa-86e5-d2c43745e927 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:06.800077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1342/2672] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:06.806292 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46093c-f0ed-400e-b98f-c91de5a06d0e admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:06.819186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46093c-f0ed-400e-b98f-c91de5a06d0e admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:06.824537 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56d8a6-67f4-4be2-a7f3-fcf74effd69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:06.825738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d8a6-67f4-4be2-a7f3-fcf74effd69a admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.825903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d8a6-67f4-4be2-a7f3-fcf74effd69a admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.826207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d8a6-67f4-4be2-a7f3-fcf74effd69a admin admin] PATH_INFO: `/v3/projects/2a319ffea6c842a488a0350a94246723/users/72fb590b3edb411dbeeb046286c9ea92/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.844346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56d8a6-67f4-4be2-a7f3-fcf74effd69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a319ffea6c842a488a0350a94246723, user_id=72fb590b3edb411dbeeb046286c9ea92, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:06.847833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56d8a6-67f4-4be2-a7f3-fcf74effd69a admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:06.866503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1331/2673] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:06 2022] PUT /identity/v3/projects/2a319ffea6c842a488a0350a94246723/users/72fb590b3edb411dbeeb046286c9ea92/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:06.877072 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a84acc-0bc6-416e-879c-e0de008b2d13 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:06.878005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a84acc-0bc6-416e-879c-e0de008b2d13 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:06.878276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a84acc-0bc6-416e-879c-e0de008b2d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:06.912371 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-95a84acc-0bc6-416e-879c-e0de008b2d13 None None] MFA Rules not processed for user `72fb590b3edb411dbeeb046286c9ea92`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:06.913837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-95a84acc-0bc6-416e-879c-e0de008b2d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:06.985457 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1343/2674] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:06 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:06.990278 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56d8a6-67f4-4be2-a7f3-fcf74effd69a admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.059868 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56d8a6-67f4-4be2-a7f3-fcf74effd69a admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.066013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15379fef-7baf-4045-8076-27c2072d1c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.066708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15379fef-7baf-4045-8076-27c2072d1c25 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.066994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15379fef-7baf-4045-8076-27c2072d1c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.067270 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15379fef-7baf-4045-8076-27c2072d1c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.068006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15379fef-7baf-4045-8076-27c2072d1c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.069951 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15379fef-7baf-4045-8076-27c2072d1c25 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.100129 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1332/2675] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:06 2022] POST /identity/v3/projects => generated 355 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:07.104464 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a84acc-0bc6-416e-879c-e0de008b2d13 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.117108 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a84acc-0bc6-416e-879c-e0de008b2d13 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.185757 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f45627-55b3-4320-9d09-2dec74f033a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.186446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f45627-55b3-4320-9d09-2dec74f033a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.186734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f45627-55b3-4320-9d09-2dec74f033a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.187027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f45627-55b3-4320-9d09-2dec74f033a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.187697 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f45627-55b3-4320-9d09-2dec74f033a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.192510 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f45627-55b3-4320-9d09-2dec74f033a8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.217599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cc4b0-eb9d-464d-8373-0fc9bd811990 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.218306 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cc4b0-eb9d-464d-8373-0fc9bd811990 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.218615 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cc4b0-eb9d-464d-8373-0fc9bd811990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.220621 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1344/2676] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:07 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:07.224748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f45627-55b3-4320-9d09-2dec74f033a8 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.239745 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f45627-55b3-4320-9d09-2dec74f033a8 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.245224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb153781-0286-4b79-86b0-0636ef422f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.245990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb153781-0286-4b79-86b0-0636ef422f37 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.246792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb153781-0286-4b79-86b0-0636ef422f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.246792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb153781-0286-4b79-86b0-0636ef422f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.247544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb153781-0286-4b79-86b0-0636ef422f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.249279 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb153781-0286-4b79-86b0-0636ef422f37 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.252354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-a51cc4b0-eb9d-464d-8373-0fc9bd811990 None None] MFA Rules not processed for user `c96ed3bc83aa407da115d1a79e26afd4`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:07.253816 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a51cc4b0-eb9d-464d-8373-0fc9bd811990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:07.263680 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1345/2677] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:07.264796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb153781-0286-4b79-86b0-0636ef422f37 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.276875 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb153781-0286-4b79-86b0-0636ef422f37 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.281869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa73303-b835-4ce3-8410-f3b33bb94cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.282860 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa73303-b835-4ce3-8410-f3b33bb94cea admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.283219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa73303-b835-4ce3-8410-f3b33bb94cea admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.284357 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa73303-b835-4ce3-8410-f3b33bb94cea admin admin] PATH_INFO: `/v3/projects/5f0a95e888f04916b27d930df1067535/users/7aedb291d0ba4f2cb7001ff48f7c3c2f/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.304803 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa73303-b835-4ce3-8410-f3b33bb94cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0a95e888f04916b27d930df1067535, user_id=7aedb291d0ba4f2cb7001ff48f7c3c2f, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.307689 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa73303-b835-4ce3-8410-f3b33bb94cea admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.332829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1346/2678] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:07 2022] PUT /identity/v3/projects/5f0a95e888f04916b27d930df1067535/users/7aedb291d0ba4f2cb7001ff48f7c3c2f/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:07.335214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa73303-b835-4ce3-8410-f3b33bb94cea admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.374811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1333/2679] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:07.376737 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cc4b0-eb9d-464d-8373-0fc9bd811990 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.379570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a51cc4b0-eb9d-464d-8373-0fc9bd811990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:07.399018 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cc4b0-eb9d-464d-8373-0fc9bd811990 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.418253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa73303-b835-4ce3-8410-f3b33bb94cea admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.423470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608c880-2965-4904-bed7-9f7e23643cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.424214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608c880-2965-4904-bed7-9f7e23643cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.424492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608c880-2965-4904-bed7-9f7e23643cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.424769 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608c880-2965-4904-bed7-9f7e23643cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.425962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608c880-2965-4904-bed7-9f7e23643cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.427602 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608c880-2965-4904-bed7-9f7e23643cf5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.441109 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1347/2680] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:57:07.445236 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608c880-2965-4904-bed7-9f7e23643cf5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.456598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608c880-2965-4904-bed7-9f7e23643cf5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.460463 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efc451-9c8b-4ad3-9f91-acec04e6bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.461123 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc451-9c8b-4ad3-9f91-acec04e6bae3 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.461257 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee7e42-8ea4-4b57-8329-08b1f985e7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.461404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc451-9c8b-4ad3-9f91-acec04e6bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.461685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc451-9c8b-4ad3-9f91-acec04e6bae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.462064 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7e42-8ea4-4b57-8329-08b1f985e7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.462352 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7e42-8ea4-4b57-8329-08b1f985e7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.462487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efc451-9c8b-4ad3-9f91-acec04e6bae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.462633 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7e42-8ea4-4b57-8329-08b1f985e7b6 admin admin] PATH_INFO: `/v3/projects/5f0a95e888f04916b27d930df1067535/users/7aedb291d0ba4f2cb7001ff48f7c3c2f/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.464424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efc451-9c8b-4ad3-9f91-acec04e6bae3 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.464879 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee7e42-8ea4-4b57-8329-08b1f985e7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0a95e888f04916b27d930df1067535, user_id=7aedb291d0ba4f2cb7001ff48f7c3c2f, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.467785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee7e42-8ea4-4b57-8329-08b1f985e7b6 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.478933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1348/2681] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:07 2022] PUT /identity/v3/projects/5f0a95e888f04916b27d930df1067535/users/7aedb291d0ba4f2cb7001ff48f7c3c2f/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:07.492046 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062b4d-17cc-478d-a3f3-250214e830a8 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.492264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062b4d-17cc-478d-a3f3-250214e830a8 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.492542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44062b4d-17cc-478d-a3f3-250214e830a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.497734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1334/2682] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:07 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:07.498779 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efc451-9c8b-4ad3-9f91-acec04e6bae3 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.519474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-44062b4d-17cc-478d-a3f3-250214e830a8 None None] MFA Rules not processed for user `7aedb291d0ba4f2cb7001ff48f7c3c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:07.520721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-44062b4d-17cc-478d-a3f3-250214e830a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:07.559637 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efc451-9c8b-4ad3-9f91-acec04e6bae3 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.564396 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4ff5f-53b3-4ec6-8c04-5c7bd1bbb131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.565870 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ff5f-53b3-4ec6-8c04-5c7bd1bbb131 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.566167 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ff5f-53b3-4ec6-8c04-5c7bd1bbb131 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.566446 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ff5f-53b3-4ec6-8c04-5c7bd1bbb131 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.567143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4ff5f-53b3-4ec6-8c04-5c7bd1bbb131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.569111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4ff5f-53b3-4ec6-8c04-5c7bd1bbb131 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.589812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1349/2684] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:57:07.590024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1335/2684] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:07 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:07.594071 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062b4d-17cc-478d-a3f3-250214e830a8 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.602430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4ff5f-53b3-4ec6-8c04-5c7bd1bbb131 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.604225 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c5b4ff5f-53b3-4ec6-8c04-5c7bd1bbb131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:07.611079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44062b4d-17cc-478d-a3f3-250214e830a8 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.616884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ad1d-bf8f-491d-b98f-e1f6ae9bd7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.617771 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ad1d-bf8f-491d-b98f-e1f6ae9bd7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.618132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ad1d-bf8f-491d-b98f-e1f6ae9bd7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.618451 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ad1d-bf8f-491d-b98f-e1f6ae9bd7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.619231 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757ad1d-bf8f-491d-b98f-e1f6ae9bd7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.620982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757ad1d-bf8f-491d-b98f-e1f6ae9bd7a3 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.637604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1350/2685] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:57:07.639186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ad1d-bf8f-491d-b98f-e1f6ae9bd7a3 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.650075 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ad1d-bf8f-491d-b98f-e1f6ae9bd7a3 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.654769 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5de7-8863-4719-a5f9-87a3c248f8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.655653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5de7-8863-4719-a5f9-87a3c248f8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.655967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5de7-8863-4719-a5f9-87a3c248f8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.656246 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5de7-8863-4719-a5f9-87a3c248f8d5 admin admin] PATH_INFO: `/v3/projects/ab9961585d5b48e28e2748dc6bcfe157/users/a6027eabd3a94025a8159cd18a6e6640/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.670733 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4ff5f-53b3-4ec6-8c04-5c7bd1bbb131 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.672145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a5de7-8863-4719-a5f9-87a3c248f8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab9961585d5b48e28e2748dc6bcfe157, user_id=a6027eabd3a94025a8159cd18a6e6640, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.674619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e305b3-35d5-41b2-b3a3-4bcf9c9567b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.675296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e305b3-35d5-41b2-b3a3-4bcf9c9567b5 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.675576 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e305b3-35d5-41b2-b3a3-4bcf9c9567b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.675946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e305b3-35d5-41b2-b3a3-4bcf9c9567b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.679951 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a5de7-8863-4719-a5f9-87a3c248f8d5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.685367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e305b3-35d5-41b2-b3a3-4bcf9c9567b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.686778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e305b3-35d5-41b2-b3a3-4bcf9c9567b5 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.693777 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1351/2686] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:07 2022] PUT /identity/v3/projects/ab9961585d5b48e28e2748dc6bcfe157/users/a6027eabd3a94025a8159cd18a6e6640/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:07.696831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1336/2687] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:07 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:57:07.697624 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5de7-8863-4719-a5f9-87a3c248f8d5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.769552 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5de7-8863-4719-a5f9-87a3c248f8d5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.774460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce7cce-0dd7-47a5-a264-45310d1feaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.775127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce7cce-0dd7-47a5-a264-45310d1feaaa admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.775441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce7cce-0dd7-47a5-a264-45310d1feaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.775746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce7cce-0dd7-47a5-a264-45310d1feaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.777058 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce7cce-0dd7-47a5-a264-45310d1feaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.778650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce7cce-0dd7-47a5-a264-45310d1feaaa admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.787097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e305b3-35d5-41b2-b3a3-4bcf9c9567b5 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.792887 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1352/2688] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:57:07.794443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce7cce-0dd7-47a5-a264-45310d1feaaa admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:07.795866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e305b3-35d5-41b2-b3a3-4bcf9c9567b5 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.808062 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce7cce-0dd7-47a5-a264-45310d1feaaa admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:07.816251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704f0e3-cce1-45bc-a5c5-6935d8753d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.817164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704f0e3-cce1-45bc-a5c5-6935d8753d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.817455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704f0e3-cce1-45bc-a5c5-6935d8753d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.817852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704f0e3-cce1-45bc-a5c5-6935d8753d57 admin admin] PATH_INFO: `/v3/projects/ab9961585d5b48e28e2748dc6bcfe157/users/a6027eabd3a94025a8159cd18a6e6640/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.821385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704f0e3-cce1-45bc-a5c5-6935d8753d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab9961585d5b48e28e2748dc6bcfe157, user_id=a6027eabd3a94025a8159cd18a6e6640, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.826987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704f0e3-cce1-45bc-a5c5-6935d8753d57 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.840671 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1353/2689] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:07 2022] PUT /identity/v3/projects/ab9961585d5b48e28e2748dc6bcfe157/users/a6027eabd3a94025a8159cd18a6e6640/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:07.867307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b85f8d-dba4-4d65-954a-eedc4a295f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:07.868881 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b85f8d-dba4-4d65-954a-eedc4a295f73 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:07.869244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b85f8d-dba4-4d65-954a-eedc4a295f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:07.869673 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b85f8d-dba4-4d65-954a-eedc4a295f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:07.969017 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b85f8d-dba4-4d65-954a-eedc4a295f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:07.970689 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b85f8d-dba4-4d65-954a-eedc4a295f73 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:07.981674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1337/2690] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:07 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:57:08.628500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baea96-c9b7-4fcb-a6cd-cd72caf5fc05 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:08.630060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baea96-c9b7-4fcb-a6cd-cd72caf5fc05 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:08.630060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baea96-c9b7-4fcb-a6cd-cd72caf5fc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:08.662398 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-e6baea96-c9b7-4fcb-a6cd-cd72caf5fc05 None None] MFA Rules not processed for user `a6027eabd3a94025a8159cd18a6e6640`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:08.663795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e6baea96-c9b7-4fcb-a6cd-cd72caf5fc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:08.753747 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1354/2691] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:08.761178 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b85f8d-dba4-4d65-954a-eedc4a295f73 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:08.772923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b85f8d-dba4-4d65-954a-eedc4a295f73 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:08.859224 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52c195-7297-4905-a545-a358d89ace60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:08.859947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c195-7297-4905-a545-a358d89ace60 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:08.860210 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c195-7297-4905-a545-a358d89ace60 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:08.860498 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c195-7297-4905-a545-a358d89ace60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:08.929374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52c195-7297-4905-a545-a358d89ace60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:08.930834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52c195-7297-4905-a545-a358d89ace60 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:08.940147 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1338/2692] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:10.319644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baea96-c9b7-4fcb-a6cd-cd72caf5fc05 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:10.329655 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baea96-c9b7-4fcb-a6cd-cd72caf5fc05 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:10.334322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b63c1e-a706-4f9a-8564-7ff842fa876d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:10.334991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b63c1e-a706-4f9a-8564-7ff842fa876d service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:10.335271 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b63c1e-a706-4f9a-8564-7ff842fa876d service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:10.335548 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b63c1e-a706-4f9a-8564-7ff842fa876d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:10.345660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b63c1e-a706-4f9a-8564-7ff842fa876d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:10.347210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b63c1e-a706-4f9a-8564-7ff842fa876d service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:10.357646 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1355/2693] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:10.701097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52c195-7297-4905-a545-a358d89ace60 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:10.702620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3b52c195-7297-4905-a545-a358d89ace60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:10.781325 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52c195-7297-4905-a545-a358d89ace60 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:10.786906 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:10.787741 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:10.788154 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:10.788326 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] PATH_INFO: `/v3/users/1fb382e0d42248c2b38c415c369d2e73` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:10.789646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb382e0d42248c2b38c415c369d2e73)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:10.791658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:10.845489 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb382e0d42248c2b38c415c369d2e73'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:10.857886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb382e0d42248c2b38c415c369d2e73'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:10.858610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb382e0d42248c2b38c415c369d2e73'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:10.859207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb382e0d42248c2b38c415c369d2e73'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:10.866864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb382e0d42248c2b38c415c369d2e73'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:10.879760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1339/2694] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:10 2022] DELETE /identity/v3/users/1fb382e0d42248c2b38c415c369d2e73 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:10.884381 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce85aa-c9ab-4d01-a6ed-c4b873a599d2 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:10.884666 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce85aa-c9ab-4d01-a6ed-c4b873a599d2 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:10.884950 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce85aa-c9ab-4d01-a6ed-c4b873a599d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:10.903446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-35ce85aa-c9ab-4d01-a6ed-c4b873a599d2 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:10.904711 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-35ce85aa-c9ab-4d01-a6ed-c4b873a599d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:10.967184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1356/2695] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:10.977331 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:10.978763 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:11.039276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbfa01-7f5f-4e97-b15d-99f96fa0cd03 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:11.042989 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e0e07-29a2-447a-ae76-013cb7214ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:11.043659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e0e07-29a2-447a-ae76-013cb7214ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:11.043986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e0e07-29a2-447a-ae76-013cb7214ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:11.044357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e0e07-29a2-447a-ae76-013cb7214ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:11.054772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e0e07-29a2-447a-ae76-013cb7214ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:11.056268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e0e07-29a2-447a-ae76-013cb7214ea1 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:11.067883 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1340/2696] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:11.342128 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce85aa-c9ab-4d01-a6ed-c4b873a599d2 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:11.343628 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-35ce85aa-c9ab-4d01-a6ed-c4b873a599d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:11.356272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce85aa-c9ab-4d01-a6ed-c4b873a599d2 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:11.360959 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:11.362341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:11.362622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:11.363087 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] PATH_INFO: `/v3/projects/99efa7c9f2a64950bf0b8c72bb202015` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:11.364370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99efa7c9f2a64950bf0b8c72bb202015)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:11.366462 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:11.415836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99efa7c9f2a64950bf0b8c72bb202015', 'request_id': 'req-39006783-7483-41ee-b4df-f8803600d312'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:11.422312 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99efa7c9f2a64950bf0b8c72bb202015', 'request_id': 'req-39006783-7483-41ee-b4df-f8803600d312'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:11.432282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99efa7c9f2a64950bf0b8c72bb202015', 'request_id': 'req-39006783-7483-41ee-b4df-f8803600d312'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:11.445843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] The token cache is being invalidate because project 99efa7c9f2a64950bf0b8c72bb202015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:11.446133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:11.446790 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:11.448541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1357/2697] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:11 2022] DELETE /identity/v3/projects/99efa7c9f2a64950bf0b8c72bb202015 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:11.452748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e0e07-29a2-447a-ae76-013cb7214ea1 service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:11.462382 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e0e07-29a2-447a-ae76-013cb7214ea1 service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:11.518593 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:11.519479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:11.519799 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:11.520099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] PATH_INFO: `/v3/users/eaee58b7b5ef464091554ef2c8636cbf` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:11.521300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaee58b7b5ef464091554ef2c8636cbf)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:11.523248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:11.572295 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaee58b7b5ef464091554ef2c8636cbf'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:11.584729 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaee58b7b5ef464091554ef2c8636cbf'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:11.585375 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaee58b7b5ef464091554ef2c8636cbf'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:11.586009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaee58b7b5ef464091554ef2c8636cbf'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:11.595444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaee58b7b5ef464091554ef2c8636cbf'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:11.609146 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1341/2698] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:11 2022] DELETE /identity/v3/users/eaee58b7b5ef464091554ef2c8636cbf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:11.893629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:11.895260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:11.918511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39006783-7483-41ee-b4df-f8803600d312 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:11.979047 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:11.979961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:11.980245 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:11.980520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] PATH_INFO: `/v3/projects/57d19ea1b3e14a21b992ceba3156698d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:11.981736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d19ea1b3e14a21b992ceba3156698d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:11.983639 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:12.032046 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d19ea1b3e14a21b992ceba3156698d', 'request_id': 'req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.039280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d19ea1b3e14a21b992ceba3156698d', 'request_id': 'req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.047211 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d19ea1b3e14a21b992ceba3156698d', 'request_id': 'req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.058729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] The token cache is being invalidate because project 57d19ea1b3e14a21b992ceba3156698d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:12.059019 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.059668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.061258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1358/2699] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:11 2022] DELETE /identity/v3/projects/57d19ea1b3e14a21b992ceba3156698d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:12.065988 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:12.067680 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:12.080111 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507f904-f7bb-4443-be3d-285a3e46d7da admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:12.138157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:12.139045 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:12.139330 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:12.139606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] PATH_INFO: `/v3/users/e2adda16d4294bed989b17645c3a5519` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:12.140861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2adda16d4294bed989b17645c3a5519)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:12.142931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:12.190148 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2adda16d4294bed989b17645c3a5519'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.202983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2adda16d4294bed989b17645c3a5519'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.203834 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2adda16d4294bed989b17645c3a5519'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.204469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2adda16d4294bed989b17645c3a5519'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.212387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2adda16d4294bed989b17645c3a5519'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.225447 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1342/2700] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:12 2022] DELETE /identity/v3/users/e2adda16d4294bed989b17645c3a5519 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:12.497602 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:12.499084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:12.512435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9494b7e-2d1c-4169-b00a-0d53b5f42f69 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:12.573026 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:12.573898 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:12.574184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:12.574508 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] PATH_INFO: `/v3/projects/721ba84dc1884d28a889d27c5a6dc660` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:12.575774 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=721ba84dc1884d28a889d27c5a6dc660)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:12.577707 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:12.631728 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '721ba84dc1884d28a889d27c5a6dc660', 'request_id': 'req-2dc73838-be49-45ae-be4a-3eb7b759c0c1'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.638094 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '721ba84dc1884d28a889d27c5a6dc660', 'request_id': 'req-2dc73838-be49-45ae-be4a-3eb7b759c0c1'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.645892 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '721ba84dc1884d28a889d27c5a6dc660', 'request_id': 'req-2dc73838-be49-45ae-be4a-3eb7b759c0c1'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.656823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] The token cache is being invalidate because project 721ba84dc1884d28a889d27c5a6dc660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:12.657120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.657776 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-2dc73838-be49-45ae-be4a-3eb7b759c0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:12.661764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1359/2701] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:12 2022] DELETE /identity/v3/projects/721ba84dc1884d28a889d27c5a6dc660 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:17.779633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:17.781136 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:17.796520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba07ac-9ed3-4e64-8de6-a0f1bb45acd5 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:17.857430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:17.858305 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:17.858596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:17.858875 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] PATH_INFO: `/v3/users/9d813f03273447c2ab0e152e238f34cf` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:17.860150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d813f03273447c2ab0e152e238f34cf)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:17.862653 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:17.910827 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d813f03273447c2ab0e152e238f34cf'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:17.925276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d813f03273447c2ab0e152e238f34cf'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:17.926099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d813f03273447c2ab0e152e238f34cf'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:17.926705 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d813f03273447c2ab0e152e238f34cf'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:17.935864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d813f03273447c2ab0e152e238f34cf'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:17.948145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1343/2702] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:17 2022] DELETE /identity/v3/users/9d813f03273447c2ab0e152e238f34cf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:17.952661 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612847-a36c-410a-94d7-58fb65936cee None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:17.953131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612847-a36c-410a-94d7-58fb65936cee None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:17.953243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612847-a36c-410a-94d7-58fb65936cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:17.973336 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-e2612847-a36c-410a-94d7-58fb65936cee None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:17.974548 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e2612847-a36c-410a-94d7-58fb65936cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:18.031956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1360/2703] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:18.042722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:18.044157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:18.099908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0b36a-61e5-4ea6-a5ba-a702cc292746 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:18.103529 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd53b0-ef57-4fd4-a0c0-7efe81e3c7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:18.104266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd53b0-ef57-4fd4-a0c0-7efe81e3c7df service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:18.104570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd53b0-ef57-4fd4-a0c0-7efe81e3c7df service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:18.104954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd53b0-ef57-4fd4-a0c0-7efe81e3c7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:18.114021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd53b0-ef57-4fd4-a0c0-7efe81e3c7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:18.115744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd53b0-ef57-4fd4-a0c0-7efe81e3c7df service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:18.124810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1344/2704] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:57:18.394439 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2612847-a36c-410a-94d7-58fb65936cee None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:18.396568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-e2612847-a36c-410a-94d7-58fb65936cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:18.411106 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2612847-a36c-410a-94d7-58fb65936cee None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:18.420571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:18.420725 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:18.421014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:18.421287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] PATH_INFO: `/v3/projects/d8e71bba433349eb81f9a3cc4b0b9b4d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:18.423276 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e71bba433349eb81f9a3cc4b0b9b4d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:18.425511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:18.491870 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e71bba433349eb81f9a3cc4b0b9b4d', 'request_id': 'req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:18.498933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e71bba433349eb81f9a3cc4b0b9b4d', 'request_id': 'req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:18.509796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e71bba433349eb81f9a3cc4b0b9b4d', 'request_id': 'req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:18.525077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] The token cache is being invalidate because project d8e71bba433349eb81f9a3cc4b0b9b4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:18.525574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:18.526381 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c1cd8549-d841-4f47-b31a-ef1c8fa5bd20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:18.528263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1361/2705] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:18 2022] DELETE /identity/v3/projects/d8e71bba433349eb81f9a3cc4b0b9b4d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:18.533550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53909a-8e0b-4ce9-beb8-dfbab9e9729d None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:18.533849 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53909a-8e0b-4ce9-beb8-dfbab9e9729d None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:18.534164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53909a-8e0b-4ce9-beb8-dfbab9e9729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:18.552606 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-4f53909a-8e0b-4ce9-beb8-dfbab9e9729d None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:18.553933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4f53909a-8e0b-4ce9-beb8-dfbab9e9729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:18.615654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1345/2706] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:18.623808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f1fc-c38b-4fb0-8e31-d72fa0aab31b None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:18.624101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f1fc-c38b-4fb0-8e31-d72fa0aab31b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:18.624385 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f1fc-c38b-4fb0-8e31-d72fa0aab31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:18.644792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-69a9f1fc-c38b-4fb0-8e31-d72fa0aab31b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:18.646015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-69a9f1fc-c38b-4fb0-8e31-d72fa0aab31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:18.654885 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1362/2707] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:18.659648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53909a-8e0b-4ce9-beb8-dfbab9e9729d None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:18.669979 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53909a-8e0b-4ce9-beb8-dfbab9e9729d None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:18.674921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f0e56-10e8-4cd4-915b-5737427eb487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:18.675625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f0e56-10e8-4cd4-915b-5737427eb487 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:18.675941 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f0e56-10e8-4cd4-915b-5737427eb487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:18.676224 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f0e56-10e8-4cd4-915b-5737427eb487 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:18.676958 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f0e56-10e8-4cd4-915b-5737427eb487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:18.677267 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f0e56-10e8-4cd4-915b-5737427eb487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:18.678868 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f0e56-10e8-4cd4-915b-5737427eb487 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:18.691457 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1346/2708] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:57:18.695994 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f1fc-c38b-4fb0-8e31-d72fa0aab31b None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:18.705227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f1fc-c38b-4fb0-8e31-d72fa0aab31b None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:18.710872 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb347d7-c5a5-48cc-9d91-11c2c0db2bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:18.711543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb347d7-c5a5-48cc-9d91-11c2c0db2bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:18.711852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb347d7-c5a5-48cc-9d91-11c2c0db2bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:18.712125 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb347d7-c5a5-48cc-9d91-11c2c0db2bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:18.712829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb347d7-c5a5-48cc-9d91-11c2c0db2bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:18.714753 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb347d7-c5a5-48cc-9d91-11c2c0db2bc6 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:18.741091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1363/2709] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:18 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:18.745206 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f0e56-10e8-4cd4-915b-5737427eb487 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:18.755930 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f0e56-10e8-4cd4-915b-5737427eb487 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:18.815128 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9579542-d2b5-462c-bd94-0b07b713fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:18.815900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9579542-d2b5-462c-bd94-0b07b713fc2c admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:18.816194 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9579542-d2b5-462c-bd94-0b07b713fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:18.816472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9579542-d2b5-462c-bd94-0b07b713fc2c admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:18.817164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9579542-d2b5-462c-bd94-0b07b713fc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:18.819071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9579542-d2b5-462c-bd94-0b07b713fc2c admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:18.842719 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1347/2710] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:18 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:18.844009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb347d7-c5a5-48cc-9d91-11c2c0db2bc6 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:18.854440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb347d7-c5a5-48cc-9d91-11c2c0db2bc6 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:18.860656 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e53ec-8f81-4daf-af6e-c9cd3f31cd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:18.861865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e53ec-8f81-4daf-af6e-c9cd3f31cd47 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:18.862169 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e53ec-8f81-4daf-af6e-c9cd3f31cd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:18.862447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e53ec-8f81-4daf-af6e-c9cd3f31cd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:18.863374 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e53ec-8f81-4daf-af6e-c9cd3f31cd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:18.865010 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e53ec-8f81-4daf-af6e-c9cd3f31cd47 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:18.879738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1364/2711] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:18.881386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9579542-d2b5-462c-bd94-0b07b713fc2c admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:18.891202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9579542-d2b5-462c-bd94-0b07b713fc2c admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:18.895961 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af38c-a38e-4dbf-9111-81d01fd3ff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:18.896628 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af38c-a38e-4dbf-9111-81d01fd3ff71 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:18.896913 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af38c-a38e-4dbf-9111-81d01fd3ff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:18.897192 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af38c-a38e-4dbf-9111-81d01fd3ff71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:18.897924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382af38c-a38e-4dbf-9111-81d01fd3ff71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:18.899648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382af38c-a38e-4dbf-9111-81d01fd3ff71 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:18.911795 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1348/2712] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:18.915584 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e53ec-8f81-4daf-af6e-c9cd3f31cd47 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:18.927014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e53ec-8f81-4daf-af6e-c9cd3f31cd47 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:18.932307 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f649277-350f-4f70-9054-9d12255e637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:18.933474 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f649277-350f-4f70-9054-9d12255e637c admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:18.933966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f649277-350f-4f70-9054-9d12255e637c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:18.934426 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f649277-350f-4f70-9054-9d12255e637c admin admin] PATH_INFO: `/v3/projects/9cf09aab60304f30ae52a87b7b1ea81a/users/9cb61d5251e74d529a6bfa7d3a684123/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:18.951304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f649277-350f-4f70-9054-9d12255e637c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf09aab60304f30ae52a87b7b1ea81a, user_id=9cb61d5251e74d529a6bfa7d3a684123, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:18.954041 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f649277-350f-4f70-9054-9d12255e637c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:18.968079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1365/2713] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:18 2022] PUT /identity/v3/projects/9cf09aab60304f30ae52a87b7b1ea81a/users/9cb61d5251e74d529a6bfa7d3a684123/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:18.976157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8ff10-e8bf-421f-b6a2-f096c1b02113 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:18.976454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8ff10-e8bf-421f-b6a2-f096c1b02113 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:18.976731 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8ff10-e8bf-421f-b6a2-f096c1b02113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:18.995954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-cff8ff10-e8bf-421f-b6a2-f096c1b02113 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:18.997505 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-cff8ff10-e8bf-421f-b6a2-f096c1b02113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:19.069138 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1349/2714] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:57:19.077848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f649277-350f-4f70-9054-9d12255e637c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:19.079581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8f649277-350f-4f70-9054-9d12255e637c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:19.141560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f649277-350f-4f70-9054-9d12255e637c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:19.145237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2684abe-81ed-48b1-895e-df442135b74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:19.145884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684abe-81ed-48b1-895e-df442135b74c service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:19.146185 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684abe-81ed-48b1-895e-df442135b74c service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:19.146460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684abe-81ed-48b1-895e-df442135b74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:19.155475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2684abe-81ed-48b1-895e-df442135b74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:19.156955 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2684abe-81ed-48b1-895e-df442135b74c service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:19.167228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1366/2715] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:19.772903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021e7c-4241-47a8-b274-a33d2cac92c3 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:19.773197 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021e7c-4241-47a8-b274-a33d2cac92c3 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:19.773513 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021e7c-4241-47a8-b274-a33d2cac92c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:19.804735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b3021e7c-4241-47a8-b274-a33d2cac92c3 None None] MFA Rules not processed for user `9cb61d5251e74d529a6bfa7d3a684123`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:19.805916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b3021e7c-4241-47a8-b274-a33d2cac92c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:19.885775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1350/2716] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:19.894308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2684abe-81ed-48b1-895e-df442135b74c service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:19.898085 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-f2684abe-81ed-48b1-895e-df442135b74c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:19.979845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2684abe-81ed-48b1-895e-df442135b74c service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:19.983817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de2612-9686-4c59-8642-55883989cbe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:19.984480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de2612-9686-4c59-8642-55883989cbe9 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:19.984762 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de2612-9686-4c59-8642-55883989cbe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:19.985040 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de2612-9686-4c59-8642-55883989cbe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:19.994489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de2612-9686-4c59-8642-55883989cbe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:19.995978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de2612-9686-4c59-8642-55883989cbe9 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:20.006320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1367/2717] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:21.360728 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e8ae9-1c8d-4f98-8dfd-0f59182c19eb None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:21.361279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e8ae9-1c8d-4f98-8dfd-0f59182c19eb None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:21.361279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e8ae9-1c8d-4f98-8dfd-0f59182c19eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:21.379823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-323e8ae9-1c8d-4f98-8dfd-0f59182c19eb None None] MFA Rules not processed for user `9cb61d5251e74d529a6bfa7d3a684123`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:21.381392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-323e8ae9-1c8d-4f98-8dfd-0f59182c19eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:21.388255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1351/2718] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:25.169761 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de2612-9686-4c59-8642-55883989cbe9 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:25.171387 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-33de2612-9686-4c59-8642-55883989cbe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:25.190526 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de2612-9686-4c59-8642-55883989cbe9 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:25.195497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:25.196513 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:25.196800 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:25.197075 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] PATH_INFO: `/v3/users/72fb590b3edb411dbeeb046286c9ea92` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:25.198308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=72fb590b3edb411dbeeb046286c9ea92)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:25.200269 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:25.255608 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72fb590b3edb411dbeeb046286c9ea92'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:25.270068 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72fb590b3edb411dbeeb046286c9ea92'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:25.270816 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72fb590b3edb411dbeeb046286c9ea92'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:25.280033 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72fb590b3edb411dbeeb046286c9ea92'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:25.287758 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72fb590b3edb411dbeeb046286c9ea92'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:25.293817 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1368/2719] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:25 2022] DELETE /identity/v3/users/72fb590b3edb411dbeeb046286c9ea92 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:25.299398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f91e-10c4-40da-8c7e-af5c04c01ffc None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:25.300268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f91e-10c4-40da-8c7e-af5c04c01ffc None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:25.300268 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f91e-10c4-40da-8c7e-af5c04c01ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:25.318544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-2e58f91e-10c4-40da-8c7e-af5c04c01ffc None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:25.319922 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2e58f91e-10c4-40da-8c7e-af5c04c01ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:25.388908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1352/2720] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:25.398986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:25.400447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:25.475954 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5172f0-5873-4e6b-a994-59f3e84f6a2e admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:25.479674 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c346e-6aec-4b3c-8c15-ef29aaffcb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:25.480533 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c346e-6aec-4b3c-8c15-ef29aaffcb62 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:25.480818 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c346e-6aec-4b3c-8c15-ef29aaffcb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:25.481093 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c346e-6aec-4b3c-8c15-ef29aaffcb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:25.493096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c346e-6aec-4b3c-8c15-ef29aaffcb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:25.494555 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c346e-6aec-4b3c-8c15-ef29aaffcb62 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:25.513267 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1369/2721] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:25.952379 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58f91e-10c4-40da-8c7e-af5c04c01ffc None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:25.954380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-2e58f91e-10c4-40da-8c7e-af5c04c01ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:25.971679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58f91e-10c4-40da-8c7e-af5c04c01ffc None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:25.976296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:25.977200 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:25.977504 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:25.977780 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] PATH_INFO: `/v3/users/c96ed3bc83aa407da115d1a79e26afd4` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:25.979044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96ed3bc83aa407da115d1a79e26afd4)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:25.980997 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:26.029721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96ed3bc83aa407da115d1a79e26afd4'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.042898 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96ed3bc83aa407da115d1a79e26afd4'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.043633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96ed3bc83aa407da115d1a79e26afd4'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.044304 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96ed3bc83aa407da115d1a79e26afd4'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.052743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96ed3bc83aa407da115d1a79e26afd4'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.065889 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1353/2722] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:25 2022] DELETE /identity/v3/users/c96ed3bc83aa407da115d1a79e26afd4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:26.123016 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c346e-6aec-4b3c-8c15-ef29aaffcb62 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:26.124504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-828c346e-6aec-4b3c-8c15-ef29aaffcb62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:26.139319 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c346e-6aec-4b3c-8c15-ef29aaffcb62 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:26.216888 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:26.217903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:26.218463 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:26.218847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] PATH_INFO: `/v3/projects/2a319ffea6c842a488a0350a94246723` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:26.220212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a319ffea6c842a488a0350a94246723)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:26.222547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:26.265353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:26.266867 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:26.280759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ba67-cd27-4e8b-b2f0-3d6627cb2135 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:26.289643 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a319ffea6c842a488a0350a94246723', 'request_id': 'req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.298447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a319ffea6c842a488a0350a94246723', 'request_id': 'req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.307359 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a319ffea6c842a488a0350a94246723', 'request_id': 'req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.319615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] The token cache is being invalidate because project 2a319ffea6c842a488a0350a94246723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:26.319852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.320497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.322055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1370/2723] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:26 2022] DELETE /identity/v3/projects/2a319ffea6c842a488a0350a94246723 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:26.325946 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:26.327843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:26.349472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:26.350351 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:26.350643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:26.350918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] PATH_INFO: `/v3/projects/2d0ec0d48e214633a80ad3b675b00038` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:26.352300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0ec0d48e214633a80ad3b675b00038)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:26.354250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:26.401609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c64b5-1d87-46d8-bb32-02c0e2438c95 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:26.406288 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0ec0d48e214633a80ad3b675b00038', 'request_id': 'req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.412700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0ec0d48e214633a80ad3b675b00038', 'request_id': 'req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.422775 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0ec0d48e214633a80ad3b675b00038', 'request_id': 'req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.436389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] The token cache is being invalidate because project 2d0ec0d48e214633a80ad3b675b00038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:26.436697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.437562 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.440708 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1354/2724] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:26 2022] DELETE /identity/v3/projects/2d0ec0d48e214633a80ad3b675b00038 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:26.446047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:26.447760 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:26.471953 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:26.474317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:26.474317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:26.474317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] PATH_INFO: `/v3/users/7aedb291d0ba4f2cb7001ff48f7c3c2f` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:26.474653 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aedb291d0ba4f2cb7001ff48f7c3c2f)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:26.476663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:26.514544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da21f-3329-4a3e-adbd-712ee35fd5c1 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:26.519359 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:26.520284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:26.520570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:26.520848 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] PATH_INFO: `/v3/users/a6027eabd3a94025a8159cd18a6e6640` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:26.522050 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6027eabd3a94025a8159cd18a6e6640)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:26.524002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:26.524144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aedb291d0ba4f2cb7001ff48f7c3c2f'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.537308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aedb291d0ba4f2cb7001ff48f7c3c2f'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.538134 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aedb291d0ba4f2cb7001ff48f7c3c2f'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.548188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aedb291d0ba4f2cb7001ff48f7c3c2f'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.557203 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aedb291d0ba4f2cb7001ff48f7c3c2f'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.563535 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1371/2725] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:26 2022] DELETE /identity/v3/users/7aedb291d0ba4f2cb7001ff48f7c3c2f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:26.578166 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6027eabd3a94025a8159cd18a6e6640'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.591371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6027eabd3a94025a8159cd18a6e6640'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.592130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6027eabd3a94025a8159cd18a6e6640'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.592758 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6027eabd3a94025a8159cd18a6e6640'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.602027 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6027eabd3a94025a8159cd18a6e6640'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:26.614778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1355/2726] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:26 2022] DELETE /identity/v3/users/a6027eabd3a94025a8159cd18a6e6640 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:26.878967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:26.880521 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:26.926020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:26.927605 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:26.969886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679845-2d45-40f2-9a1c-fef15f6edf41 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.008366 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf728b-173f-41d3-ab4a-5a1aaff857a9 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.013040 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.013901 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.014188 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.014469 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] PATH_INFO: `/v3/projects/ab9961585d5b48e28e2748dc6bcfe157` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.015667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab9961585d5b48e28e2748dc6bcfe157)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.018412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.031570 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4afe1-f2a7-4abb-a4e2-f0c82cc06bb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.032329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4afe1-f2a7-4abb-a4e2-f0c82cc06bb2 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.032606 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4afe1-f2a7-4abb-a4e2-f0c82cc06bb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.033017 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4afe1-f2a7-4abb-a4e2-f0c82cc06bb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.035412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-94b4afe1-f2a7-4abb-a4e2-f0c82cc06bb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:27.066422 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab9961585d5b48e28e2748dc6bcfe157', 'request_id': 'req-3e8f6405-1a7e-49bf-852c-c6b02265894f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:27.072480 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab9961585d5b48e28e2748dc6bcfe157', 'request_id': 'req-3e8f6405-1a7e-49bf-852c-c6b02265894f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:27.080661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab9961585d5b48e28e2748dc6bcfe157', 'request_id': 'req-3e8f6405-1a7e-49bf-852c-c6b02265894f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:27.091467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] The token cache is being invalidate because project ab9961585d5b48e28e2748dc6bcfe157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:27.091827 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:27.092450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:27.094011 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1356/2727] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:26 2022] DELETE /identity/v3/projects/ab9961585d5b48e28e2748dc6bcfe157 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:27.094771 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.096115 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:27.099580 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4afe1-f2a7-4abb-a4e2-f0c82cc06bb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.101133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4afe1-f2a7-4abb-a4e2-f0c82cc06bb2 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.110414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1372/2728] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:27.112338 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c8830-6de8-4d11-b397-22592cf8fe3c None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.112636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c8830-6de8-4d11-b397-22592cf8fe3c None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.112913 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c8830-6de8-4d11-b397-22592cf8fe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.132965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-878c8830-6de8-4d11-b397-22592cf8fe3c None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:27.134183 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-878c8830-6de8-4d11-b397-22592cf8fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:27.160440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f6405-1a7e-49bf-852c-c6b02265894f admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.165367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.166232 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.166517 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.166801 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] PATH_INFO: `/v3/projects/5f0a95e888f04916b27d930df1067535` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.168034 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0a95e888f04916b27d930df1067535)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.169950 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.197865 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1373/2729] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:27.209076 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ebac8-b423-48fd-8342-aa25ea037d4e None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.209369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ebac8-b423-48fd-8342-aa25ea037d4e None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.209701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ebac8-b423-48fd-8342-aa25ea037d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.227207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0a95e888f04916b27d930df1067535', 'request_id': 'req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:27.230812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-983ebac8-b423-48fd-8342-aa25ea037d4e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:27.232061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-983ebac8-b423-48fd-8342-aa25ea037d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:27.234626 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0a95e888f04916b27d930df1067535', 'request_id': 'req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:27.246299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0a95e888f04916b27d930df1067535', 'request_id': 'req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:27.277122 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] The token cache is being invalidate because project 5f0a95e888f04916b27d930df1067535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:27.277796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:27.278921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-04a6dd59-d9d5-4d58-ab36-1b43fd289c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:27.281786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1357/2730] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:27 2022] DELETE /identity/v3/projects/5f0a95e888f04916b27d930df1067535 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:27.288082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4daa5-d1f0-4a26-ac19-1f53ea2a8126 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.288660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4daa5-d1f0-4a26-ac19-1f53ea2a8126 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.289074 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4daa5-d1f0-4a26-ac19-1f53ea2a8126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.319675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1374/2731] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:27.329177 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ebac8-b423-48fd-8342-aa25ea037d4e None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.330473 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-b1e4daa5-d1f0-4a26-ac19-1f53ea2a8126 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:27.331942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b1e4daa5-d1f0-4a26-ac19-1f53ea2a8126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:27.341536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1358/2732] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:27.343466 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ebac8-b423-48fd-8342-aa25ea037d4e None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.349912 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac2d2-41d8-44c0-a051-1df4c14998e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.350845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac2d2-41d8-44c0-a051-1df4c14998e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.350845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac2d2-41d8-44c0-a051-1df4c14998e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.351135 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac2d2-41d8-44c0-a051-1df4c14998e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.351911 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac2d2-41d8-44c0-a051-1df4c14998e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:27.352218 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac2d2-41d8-44c0-a051-1df4c14998e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.352830 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d50a6-0465-4edc-8b7f-658df2b9c853 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.353318 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d50a6-0465-4edc-8b7f-658df2b9c853 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.353413 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d50a6-0465-4edc-8b7f-658df2b9c853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.353948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac2d2-41d8-44c0-a051-1df4c14998e7 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.367079 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1375/2733] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:57:27.372470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac2d2-41d8-44c0-a051-1df4c14998e7 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.378621 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d42d50a6-0465-4edc-8b7f-658df2b9c853 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:27.380183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d42d50a6-0465-4edc-8b7f-658df2b9c853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:27.384968 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac2d2-41d8-44c0-a051-1df4c14998e7 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.388832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1359/2734] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:27.390366 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f22df2-9941-4faf-8564-2b7b99da6009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.391038 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22df2-9941-4faf-8564-2b7b99da6009 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.391322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22df2-9941-4faf-8564-2b7b99da6009 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.391604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22df2-9941-4faf-8564-2b7b99da6009 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.392847 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f22df2-9941-4faf-8564-2b7b99da6009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.393746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d50a6-0465-4edc-8b7f-658df2b9c853 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.395021 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f22df2-9941-4faf-8564-2b7b99da6009 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.403160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d50a6-0465-4edc-8b7f-658df2b9c853 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.409772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ba240-e723-4889-86af-e918718d5181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.410570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ba240-e723-4889-86af-e918718d5181 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.411280 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ba240-e723-4889-86af-e918718d5181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.411280 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ba240-e723-4889-86af-e918718d5181 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.412007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ba240-e723-4889-86af-e918718d5181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:27.412520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ba240-e723-4889-86af-e918718d5181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.414479 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ba240-e723-4889-86af-e918718d5181 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.426641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1376/2735] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:27 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:27.430324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1360/2736] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:57:27.431048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f22df2-9941-4faf-8564-2b7b99da6009 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.435084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ba240-e723-4889-86af-e918718d5181 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.446725 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ba240-e723-4889-86af-e918718d5181 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.509388 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f22df2-9941-4faf-8564-2b7b99da6009 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.513284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8689d2-dff3-4aa4-a693-884156de2460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.514490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8689d2-dff3-4aa4-a693-884156de2460 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.514490 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8689d2-dff3-4aa4-a693-884156de2460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.514854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8689d2-dff3-4aa4-a693-884156de2460 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.515735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8689d2-dff3-4aa4-a693-884156de2460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.515883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23e859-b2e1-4c8e-82ad-80f8793b5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.516675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23e859-b2e1-4c8e-82ad-80f8793b5d43 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.517035 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23e859-b2e1-4c8e-82ad-80f8793b5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.517476 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23e859-b2e1-4c8e-82ad-80f8793b5d43 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.518103 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8689d2-dff3-4aa4-a693-884156de2460 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.518370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23e859-b2e1-4c8e-82ad-80f8793b5d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.520773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23e859-b2e1-4c8e-82ad-80f8793b5d43 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.554487 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1377/2737] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:27 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:27.559803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1361/2738] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:27 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:27.559986 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23e859-b2e1-4c8e-82ad-80f8793b5d43 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.566738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8689d2-dff3-4aa4-a693-884156de2460 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.575744 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23e859-b2e1-4c8e-82ad-80f8793b5d43 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.637519 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8689d2-dff3-4aa4-a693-884156de2460 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.638127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990679bb-d103-4a58-9762-2d622a3ea707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.638811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990679bb-d103-4a58-9762-2d622a3ea707 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.639095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990679bb-d103-4a58-9762-2d622a3ea707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.639367 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990679bb-d103-4a58-9762-2d622a3ea707 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.640133 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990679bb-d103-4a58-9762-2d622a3ea707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.641748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990679bb-d103-4a58-9762-2d622a3ea707 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.642850 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0bfcf-ac6f-4d43-b40a-dee9492b38c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.643768 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0bfcf-ac6f-4d43-b40a-dee9492b38c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.644062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0bfcf-ac6f-4d43-b40a-dee9492b38c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.644342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0bfcf-ac6f-4d43-b40a-dee9492b38c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.645044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0bfcf-ac6f-4d43-b40a-dee9492b38c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.646981 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0bfcf-ac6f-4d43-b40a-dee9492b38c2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.652603 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1378/2739] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:27.656553 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990679bb-d103-4a58-9762-2d622a3ea707 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.667567 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990679bb-d103-4a58-9762-2d622a3ea707 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.668802 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1362/2740] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:27 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:27.672839 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0bfcf-ac6f-4d43-b40a-dee9492b38c2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.676244 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd79c0-3bfb-4b7a-a577-0fb6173ed426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.676934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd79c0-3bfb-4b7a-a577-0fb6173ed426 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.677219 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd79c0-3bfb-4b7a-a577-0fb6173ed426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.677497 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd79c0-3bfb-4b7a-a577-0fb6173ed426 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.678247 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd79c0-3bfb-4b7a-a577-0fb6173ed426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.680001 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd79c0-3bfb-4b7a-a577-0fb6173ed426 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.683587 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0bfcf-ac6f-4d43-b40a-dee9492b38c2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.688500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47e90d-3c7c-46c1-9a62-3b5e058be439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.689266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47e90d-3c7c-46c1-9a62-3b5e058be439 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.689734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47e90d-3c7c-46c1-9a62-3b5e058be439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.690175 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47e90d-3c7c-46c1-9a62-3b5e058be439 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.690926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47e90d-3c7c-46c1-9a62-3b5e058be439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.692592 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47e90d-3c7c-46c1-9a62-3b5e058be439 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.692717 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1379/2741] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:57:27.696760 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd79c0-3bfb-4b7a-a577-0fb6173ed426 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.707090 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1363/2742] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:57:27.707318 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd79c0-3bfb-4b7a-a577-0fb6173ed426 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.708172 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47e90d-3c7c-46c1-9a62-3b5e058be439 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.711853 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f56889-bda0-4007-90e2-3b23a91054d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.712748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f56889-bda0-4007-90e2-3b23a91054d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.713025 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f56889-bda0-4007-90e2-3b23a91054d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.713299 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f56889-bda0-4007-90e2-3b23a91054d0 admin admin] PATH_INFO: `/v3/projects/286611b554b64009887333ea2586d074/users/548ae7be960142f19ba4816ac64e9960/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.718336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47e90d-3c7c-46c1-9a62-3b5e058be439 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.723836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e2974-93cf-4781-a253-cb7e71deedcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.724646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e2974-93cf-4781-a253-cb7e71deedcd admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.725001 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e2974-93cf-4781-a253-cb7e71deedcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.725288 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e2974-93cf-4781-a253-cb7e71deedcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.726026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e2974-93cf-4781-a253-cb7e71deedcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.727806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e2974-93cf-4781-a253-cb7e71deedcd admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.728446 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f56889-bda0-4007-90e2-3b23a91054d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286611b554b64009887333ea2586d074, user_id=548ae7be960142f19ba4816ac64e9960, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.731013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f56889-bda0-4007-90e2-3b23a91054d0 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.743245 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1364/2743] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:57:27.744319 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e2974-93cf-4781-a253-cb7e71deedcd admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.745961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1380/2744] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:27 2022] PUT /identity/v3/projects/286611b554b64009887333ea2586d074/users/548ae7be960142f19ba4816ac64e9960/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:27.754552 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e2974-93cf-4781-a253-cb7e71deedcd admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.756641 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ee086-4207-4c89-b8e6-ede4f13d8cb6 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.756933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ee086-4207-4c89-b8e6-ede4f13d8cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.757212 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ee086-4207-4c89-b8e6-ede4f13d8cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.785215 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-948ee086-4207-4c89-b8e6-ede4f13d8cb6 None None] MFA Rules not processed for user `548ae7be960142f19ba4816ac64e9960`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:27.786452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-948ee086-4207-4c89-b8e6-ede4f13d8cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:27.817013 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9f3a4-4f2c-4664-9550-263dd1a5cfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.817933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9f3a4-4f2c-4664-9550-263dd1a5cfdb admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.818222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9f3a4-4f2c-4664-9550-263dd1a5cfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.818502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9f3a4-4f2c-4664-9550-263dd1a5cfdb admin admin] PATH_INFO: `/v3/projects/27f6acecbd5f4fc68157db9fef027706/users/de7064b7c7cf4bf0948e6e1fc8312f8b/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.834817 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9f3a4-4f2c-4664-9550-263dd1a5cfdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f6acecbd5f4fc68157db9fef027706, user_id=de7064b7c7cf4bf0948e6e1fc8312f8b, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:27.837653 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9f3a4-4f2c-4664-9550-263dd1a5cfdb admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:27.857743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1381/2745] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:57:27.858744 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1365/2746] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:27 2022] PUT /identity/v3/projects/27f6acecbd5f4fc68157db9fef027706/users/de7064b7c7cf4bf0948e6e1fc8312f8b/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:27.869424 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a568a-d812-44aa-b3dd-d93f9c5ee6cf None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.869782 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9f3a4-4f2c-4664-9550-263dd1a5cfdb admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:27.870070 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a568a-d812-44aa-b3dd-d93f9c5ee6cf None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.870615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a568a-d812-44aa-b3dd-d93f9c5ee6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.871612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3aa9f3a4-4f2c-4664-9550-263dd1a5cfdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:27.903082 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-719a568a-d812-44aa-b3dd-d93f9c5ee6cf None None] MFA Rules not processed for user `de7064b7c7cf4bf0948e6e1fc8312f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:27.904574 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-719a568a-d812-44aa-b3dd-d93f9c5ee6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:27.938968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9f3a4-4f2c-4664-9550-263dd1a5cfdb admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:27.944165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29c2c9-f391-46d1-a4fe-284420f7cde6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:27.944835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29c2c9-f391-46d1-a4fe-284420f7cde6 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:27.945153 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29c2c9-f391-46d1-a4fe-284420f7cde6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:27.945402 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29c2c9-f391-46d1-a4fe-284420f7cde6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:27.988362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1382/2747] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:27.992844 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a568a-d812-44aa-b3dd-d93f9c5ee6cf None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.008462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29c2c9-f391-46d1-a4fe-284420f7cde6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.009833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29c2c9-f391-46d1-a4fe-284420f7cde6 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.019918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1366/2748] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:57:28.040503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29c2c9-f391-46d1-a4fe-284420f7cde6 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.058036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a568a-d812-44aa-b3dd-d93f9c5ee6cf None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.062898 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cfb86-1417-4635-ad5a-88e85917bbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.063568 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cfb86-1417-4635-ad5a-88e85917bbf5 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.063880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cfb86-1417-4635-ad5a-88e85917bbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.064764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cfb86-1417-4635-ad5a-88e85917bbf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.065559 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cfb86-1417-4635-ad5a-88e85917bbf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.067460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cfb86-1417-4635-ad5a-88e85917bbf5 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.094338 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1383/2749] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:27 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:28.098721 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cfb86-1417-4635-ad5a-88e85917bbf5 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.109947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29c2c9-f391-46d1-a4fe-284420f7cde6 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.161151 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cfb86-1417-4635-ad5a-88e85917bbf5 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.166167 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037ff41-1455-4c6a-a189-c53a2e196183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.166880 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037ff41-1455-4c6a-a189-c53a2e196183 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.167042 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edf83a-88b0-4dae-b5de-48111a246947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.167160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037ff41-1455-4c6a-a189-c53a2e196183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.167419 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037ff41-1455-4c6a-a189-c53a2e196183 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.167952 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf83a-88b0-4dae-b5de-48111a246947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.168149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037ff41-1455-4c6a-a189-c53a2e196183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.168265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf83a-88b0-4dae-b5de-48111a246947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.168538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf83a-88b0-4dae-b5de-48111a246947 admin admin] PATH_INFO: `/v3/users/548ae7be960142f19ba4816ac64e9960` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.169748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edf83a-88b0-4dae-b5de-48111a246947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548ae7be960142f19ba4816ac64e9960)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.170056 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037ff41-1455-4c6a-a189-c53a2e196183 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.171644 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edf83a-88b0-4dae-b5de-48111a246947 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.194659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1384/2750] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:28 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:28.195849 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037ff41-1455-4c6a-a189-c53a2e196183 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.208129 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037ff41-1455-4c6a-a189-c53a2e196183 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.213321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653f210-e5c4-4f11-8dd9-14046eddcf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.213984 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653f210-e5c4-4f11-8dd9-14046eddcf6d admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.214270 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653f210-e5c4-4f11-8dd9-14046eddcf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.214549 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653f210-e5c4-4f11-8dd9-14046eddcf6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.215291 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653f210-e5c4-4f11-8dd9-14046eddcf6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.217223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653f210-e5c4-4f11-8dd9-14046eddcf6d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.222100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-20edf83a-88b0-4dae-b5de-48111a246947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548ae7be960142f19ba4816ac64e9960'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:28.230775 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1385/2751] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:28.231869 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653f210-e5c4-4f11-8dd9-14046eddcf6d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.233983 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-20edf83a-88b0-4dae-b5de-48111a246947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548ae7be960142f19ba4816ac64e9960'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:28.234734 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-20edf83a-88b0-4dae-b5de-48111a246947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548ae7be960142f19ba4816ac64e9960'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:28.235358 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-20edf83a-88b0-4dae-b5de-48111a246947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548ae7be960142f19ba4816ac64e9960'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:28.242622 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653f210-e5c4-4f11-8dd9-14046eddcf6d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.244444 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-20edf83a-88b0-4dae-b5de-48111a246947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548ae7be960142f19ba4816ac64e9960'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:28.248403 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7180b6-975e-42f3-85a9-3ea4a5caa9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.249088 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7180b6-975e-42f3-85a9-3ea4a5caa9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.249373 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7180b6-975e-42f3-85a9-3ea4a5caa9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.249658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7180b6-975e-42f3-85a9-3ea4a5caa9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.250455 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7180b6-975e-42f3-85a9-3ea4a5caa9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.252616 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7180b6-975e-42f3-85a9-3ea4a5caa9c2 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.257433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1367/2752] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:28 2022] DELETE /identity/v3/users/548ae7be960142f19ba4816ac64e9960 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:28.262099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0727a-7c5d-40d3-81ab-f28b2aadda50 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.262392 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0727a-7c5d-40d3-81ab-f28b2aadda50 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.262674 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0727a-7c5d-40d3-81ab-f28b2aadda50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.263906 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1386/2753] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:28.268593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7180b6-975e-42f3-85a9-3ea4a5caa9c2 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.270323 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1d7180b6-975e-42f3-85a9-3ea4a5caa9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:28.283269 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7180b6-975e-42f3-85a9-3ea4a5caa9c2 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.284750 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d6f0727a-7c5d-40d3-81ab-f28b2aadda50 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:28.285956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d6f0727a-7c5d-40d3-81ab-f28b2aadda50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:28.341228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe440b-5428-4a86-98f3-8702b8da0f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.342132 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe440b-5428-4a86-98f3-8702b8da0f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.342412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe440b-5428-4a86-98f3-8702b8da0f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.342714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe440b-5428-4a86-98f3-8702b8da0f15 admin admin] PATH_INFO: `/v3/projects/273c9fa70a814f9eb28488e29751116a/users/9d4e02f82cf84ac68a40f627c076bdeb/roles/627af591fe55445c83abe50f753404c9` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.347912 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1368/2754] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:57:28.357589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0727a-7c5d-40d3-81ab-f28b2aadda50 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.359342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d6f0727a-7c5d-40d3-81ab-f28b2aadda50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:28.360626 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe440b-5428-4a86-98f3-8702b8da0f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273c9fa70a814f9eb28488e29751116a, user_id=9d4e02f82cf84ac68a40f627c076bdeb, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.364342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe440b-5428-4a86-98f3-8702b8da0f15 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.381785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1387/2755] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:28 2022] PUT /identity/v3/projects/273c9fa70a814f9eb28488e29751116a/users/9d4e02f82cf84ac68a40f627c076bdeb/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:28.393633 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4070-37f1-4bd4-9d20-7d1bce101bda None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.393933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4070-37f1-4bd4-9d20-7d1bce101bda None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.394177 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4070-37f1-4bd4-9d20-7d1bce101bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.420897 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0727a-7c5d-40d3-81ab-f28b2aadda50 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.421145 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-9e4e4070-37f1-4bd4-9d20-7d1bce101bda None None] MFA Rules not processed for user `9d4e02f82cf84ac68a40f627c076bdeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:28.422322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9e4e4070-37f1-4bd4-9d20-7d1bce101bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:28.474165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210330a-7e41-4e57-b1f8-29a463c2a15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.474826 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210330a-7e41-4e57-b1f8-29a463c2a15f service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.475112 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210330a-7e41-4e57-b1f8-29a463c2a15f service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.475391 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210330a-7e41-4e57-b1f8-29a463c2a15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.492681 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1388/2756] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:57:28.497161 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e4070-37f1-4bd4-9d20-7d1bce101bda None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.539852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210330a-7e41-4e57-b1f8-29a463c2a15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.541323 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210330a-7e41-4e57-b1f8-29a463c2a15f service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.551826 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1369/2757] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:28.561756 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e4070-37f1-4bd4-9d20-7d1bce101bda None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.567186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f78a79-0fb1-4a9d-8255-9e87c8d1f8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.567917 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f78a79-0fb1-4a9d-8255-9e87c8d1f8eb admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.568204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f78a79-0fb1-4a9d-8255-9e87c8d1f8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.568490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f78a79-0fb1-4a9d-8255-9e87c8d1f8eb admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.569188 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f78a79-0fb1-4a9d-8255-9e87c8d1f8eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.571098 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f78a79-0fb1-4a9d-8255-9e87c8d1f8eb admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.600137 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1389/2758] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:28 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:28.604307 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210330a-7e41-4e57-b1f8-29a463c2a15f service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.616647 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210330a-7e41-4e57-b1f8-29a463c2a15f service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.683400 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036570a-504d-4975-8fb9-7e8f7e81eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.684044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036570a-504d-4975-8fb9-7e8f7e81eb29 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.684336 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036570a-504d-4975-8fb9-7e8f7e81eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.684643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036570a-504d-4975-8fb9-7e8f7e81eb29 admin admin] PATH_INFO: `/v3/users` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.685340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036570a-504d-4975-8fb9-7e8f7e81eb29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.687625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036570a-504d-4975-8fb9-7e8f7e81eb29 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.718806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1370/2759] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:28 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:28.720523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f78a79-0fb1-4a9d-8255-9e87c8d1f8eb admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.731402 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f78a79-0fb1-4a9d-8255-9e87c8d1f8eb admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.737205 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8806ae-92e1-4999-ba3d-bb9532a49438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.737895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8806ae-92e1-4999-ba3d-bb9532a49438 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.738175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8806ae-92e1-4999-ba3d-bb9532a49438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.738447 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8806ae-92e1-4999-ba3d-bb9532a49438 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.739187 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8806ae-92e1-4999-ba3d-bb9532a49438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.740857 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8806ae-92e1-4999-ba3d-bb9532a49438 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.755748 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1390/2760] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:28.758163 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036570a-504d-4975-8fb9-7e8f7e81eb29 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.768431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036570a-504d-4975-8fb9-7e8f7e81eb29 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.773274 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ec992-eb19-410f-a493-3576eaf4ad0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.774218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec992-eb19-410f-a493-3576eaf4ad0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.774503 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec992-eb19-410f-a493-3576eaf4ad0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.774785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec992-eb19-410f-a493-3576eaf4ad0f admin admin] PATH_INFO: `/v3/projects/27170d9c0e10445bb5014bf73bde8664/users/9b07e464f6f7467aa81515af5d18f916/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.792796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ec992-eb19-410f-a493-3576eaf4ad0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27170d9c0e10445bb5014bf73bde8664, user_id=9b07e464f6f7467aa81515af5d18f916, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.795887 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ec992-eb19-410f-a493-3576eaf4ad0f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.810932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1371/2761] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:28 2022] PUT /identity/v3/projects/27170d9c0e10445bb5014bf73bde8664/users/9b07e464f6f7467aa81515af5d18f916/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:28.815254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8806ae-92e1-4999-ba3d-bb9532a49438 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.825677 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8806ae-92e1-4999-ba3d-bb9532a49438 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.851923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ec992-eb19-410f-a493-3576eaf4ad0f admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.853926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-a97ec992-eb19-410f-a493-3576eaf4ad0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:28.898835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c46c36-8680-4a0f-8f08-e26afc437f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.899523 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c46c36-8680-4a0f-8f08-e26afc437f5a admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.899841 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c46c36-8680-4a0f-8f08-e26afc437f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.900121 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c46c36-8680-4a0f-8f08-e26afc437f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.900861 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c46c36-8680-4a0f-8f08-e26afc437f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.902463 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c46c36-8680-4a0f-8f08-e26afc437f5a admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.915507 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1391/2762] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:28.917341 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c46c36-8680-4a0f-8f08-e26afc437f5a admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:28.927484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c46c36-8680-4a0f-8f08-e26afc437f5a admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.932600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f1207-0722-4abb-b18a-37eff1a58b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:28.934251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f1207-0722-4abb-b18a-37eff1a58b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.934251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f1207-0722-4abb-b18a-37eff1a58b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.934251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f1207-0722-4abb-b18a-37eff1a58b98 admin admin] PATH_INFO: `/v3/projects/27170d9c0e10445bb5014bf73bde8664/users/9b07e464f6f7467aa81515af5d18f916/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.936284 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f1207-0722-4abb-b18a-37eff1a58b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27170d9c0e10445bb5014bf73bde8664, user_id=9b07e464f6f7467aa81515af5d18f916, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:28.940141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f1207-0722-4abb-b18a-37eff1a58b98 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:28.951212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ec992-eb19-410f-a493-3576eaf4ad0f admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:28.951435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1392/2763] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:28 2022] PUT /identity/v3/projects/27170d9c0e10445bb5014bf73bde8664/users/9b07e464f6f7467aa81515af5d18f916/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:28.961990 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f4c3-1947-4dcc-ba8a-9be81e870fcd None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:28.962274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f4c3-1947-4dcc-ba8a-9be81e870fcd None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:28.962547 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f4c3-1947-4dcc-ba8a-9be81e870fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:28.991112 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-fb76f4c3-1947-4dcc-ba8a-9be81e870fcd None None] MFA Rules not processed for user `9b07e464f6f7467aa81515af5d18f916`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:28.992350 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-fb76f4c3-1947-4dcc-ba8a-9be81e870fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:29.021544 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:29.022658 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.022946 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.023221 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] PATH_INFO: `/v3/projects/286611b554b64009887333ea2586d074` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.024496 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286611b554b64009887333ea2586d074)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:29.026431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:29.085619 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1393/2764] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:57:29.095072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286611b554b64009887333ea2586d074', 'request_id': 'req-5eb08c82-9f15-4198-9c92-f01822aa13a1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:29.099962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f4c3-1947-4dcc-ba8a-9be81e870fcd None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:29.102810 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286611b554b64009887333ea2586d074', 'request_id': 'req-5eb08c82-9f15-4198-9c92-f01822aa13a1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:29.104305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-fb76f4c3-1947-4dcc-ba8a-9be81e870fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:29.115604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286611b554b64009887333ea2586d074', 'request_id': 'req-5eb08c82-9f15-4198-9c92-f01822aa13a1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:29.133851 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] The token cache is being invalidate because project 286611b554b64009887333ea2586d074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:29.134299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:29.135971 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5eb08c82-9f15-4198-9c92-f01822aa13a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:29.138121 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1372/2765] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:28 2022] DELETE /identity/v3/projects/286611b554b64009887333ea2586d074 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:29.145025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74865028-4dcc-4c81-a172-4ef3422868ee None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.145409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74865028-4dcc-4c81-a172-4ef3422868ee None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.145831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74865028-4dcc-4c81-a172-4ef3422868ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.170762 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-74865028-4dcc-4c81-a172-4ef3422868ee None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:29.172164 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-74865028-4dcc-4c81-a172-4ef3422868ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:29.185825 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f4c3-1947-4dcc-ba8a-9be81e870fcd None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:29.250558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1373/2766] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:29.259209 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8cc12-d870-452b-98b5-fe7a965b1f2e None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.259526 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8cc12-d870-452b-98b5-fe7a965b1f2e None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.259840 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8cc12-d870-452b-98b5-fe7a965b1f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.269819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7c3c4-cbfe-4d6c-9333-e903c575bc43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:29.271239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7c3c4-cbfe-4d6c-9333-e903c575bc43 service cinder] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.271675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7c3c4-cbfe-4d6c-9333-e903c575bc43 service cinder] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.272141 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7c3c4-cbfe-4d6c-9333-e903c575bc43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.275055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-53f7c3c4-cbfe-4d6c-9333-e903c575bc43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:29.280009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-9af8cc12-d870-452b-98b5-fe7a965b1f2e None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:29.281239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9af8cc12-d870-452b-98b5-fe7a965b1f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:29.290660 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1374/2767] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:57:29.294853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8cc12-d870-452b-98b5-fe7a965b1f2e None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:29.306217 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8cc12-d870-452b-98b5-fe7a965b1f2e None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:29.311732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4205fc-17a2-4bc6-8389-6c563efbe5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:29.312430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4205fc-17a2-4bc6-8389-6c563efbe5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.312730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4205fc-17a2-4bc6-8389-6c563efbe5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.313010 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4205fc-17a2-4bc6-8389-6c563efbe5a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.313770 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4205fc-17a2-4bc6-8389-6c563efbe5a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91825) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:29.314102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4205fc-17a2-4bc6-8389-6c563efbe5a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:29.316405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4205fc-17a2-4bc6-8389-6c563efbe5a3 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:29.329063 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1375/2768] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 18:57:29.333491 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4205fc-17a2-4bc6-8389-6c563efbe5a3 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:29.346543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4205fc-17a2-4bc6-8389-6c563efbe5a3 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:29.352386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ba46c-8e5f-49e0-a88b-09bfd818f1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:29.353072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba46c-8e5f-49e0-a88b-09bfd818f1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.353360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba46c-8e5f-49e0-a88b-09bfd818f1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.353642 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba46c-8e5f-49e0-a88b-09bfd818f1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.353755 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7c3c4-cbfe-4d6c-9333-e903c575bc43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:29.354345 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ba46c-8e5f-49e0-a88b-09bfd818f1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:29.355131 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7c3c4-cbfe-4d6c-9333-e903c575bc43 service cinder] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:29.356296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ba46c-8e5f-49e0-a88b-09bfd818f1c4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:29.366903 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1394/2769] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:29.393953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1376/2770] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:29 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:29.396328 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7c3c4-cbfe-4d6c-9333-e903c575bc43 service cinder] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:29.412530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7c3c4-cbfe-4d6c-9333-e903c575bc43 service cinder] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:29.412766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ba46c-8e5f-49e0-a88b-09bfd818f1c4 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:29.414433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c03ba46c-8e5f-49e0-a88b-09bfd818f1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:29.474143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ba46c-8e5f-49e0-a88b-09bfd818f1c4 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:29.477000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13043198-3219-4354-ab11-c112382580f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:29.477749 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043198-3219-4354-ab11-c112382580f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.478036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043198-3219-4354-ab11-c112382580f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.478333 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13043198-3219-4354-ab11-c112382580f1 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.478757 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415ed7-707f-40e9-ac11-8415f5d89ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:29.479039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13043198-3219-4354-ab11-c112382580f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:29.479616 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415ed7-707f-40e9-ac11-8415f5d89ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.479939 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415ed7-707f-40e9-ac11-8415f5d89ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.480220 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f415ed7-707f-40e9-ac11-8415f5d89ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.481014 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13043198-3219-4354-ab11-c112382580f1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:29.482132 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-3f415ed7-707f-40e9-ac11-8415f5d89ee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:29.506765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1395/2771] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:29 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:29.507939 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13043198-3219-4354-ab11-c112382580f1 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:29.517980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13043198-3219-4354-ab11-c112382580f1 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:29.523122 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf17d5-66cd-478e-b76b-a5db72b99ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:29.523858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf17d5-66cd-478e-b76b-a5db72b99ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.524146 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf17d5-66cd-478e-b76b-a5db72b99ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.524432 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf17d5-66cd-478e-b76b-a5db72b99ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.525180 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf17d5-66cd-478e-b76b-a5db72b99ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:29.526895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf17d5-66cd-478e-b76b-a5db72b99ad6 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:29.540745 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1396/2772] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:29.542287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf17d5-66cd-478e-b76b-a5db72b99ad6 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:29.546509 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415ed7-707f-40e9-ac11-8415f5d89ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:29.548026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f415ed7-707f-40e9-ac11-8415f5d89ee9 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:29.552886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf17d5-66cd-478e-b76b-a5db72b99ad6 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:29.557739 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cffb3-02b6-4633-9621-7955245d54d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:29.558255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1377/2773] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:57:29.558529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cffb3-02b6-4633-9621-7955245d54d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.558820 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cffb3-02b6-4633-9621-7955245d54d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.559095 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cffb3-02b6-4633-9621-7955245d54d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.559934 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cffb3-02b6-4633-9621-7955245d54d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:29.561529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cffb3-02b6-4633-9621-7955245d54d6 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:29.573829 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1397/2774] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:57:29.578599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415ed7-707f-40e9-ac11-8415f5d89ee9 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:29.590363 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f415ed7-707f-40e9-ac11-8415f5d89ee9 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:29.595929 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b5e22-3d50-48ee-9d8e-e9ccf3db0ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:29.597130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b5e22-3d50-48ee-9d8e-e9ccf3db0ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.597434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b5e22-3d50-48ee-9d8e-e9ccf3db0ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.597704 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b5e22-3d50-48ee-9d8e-e9ccf3db0ee2 admin admin] PATH_INFO: `/v3/projects/960412c282f44c8693402a1469c9c313/users/ce5d62b34c994753bef7ced63901819a/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.619482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b5e22-3d50-48ee-9d8e-e9ccf3db0ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960412c282f44c8693402a1469c9c313, user_id=ce5d62b34c994753bef7ced63901819a, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:29.622321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b5e22-3d50-48ee-9d8e-e9ccf3db0ee2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:29.636982 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1378/2775] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:29 2022] PUT /identity/v3/projects/960412c282f44c8693402a1469c9c313/users/ce5d62b34c994753bef7ced63901819a/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:29.704122 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c63f2-474b-41ca-b07e-c856682fb167 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.704413 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c63f2-474b-41ca-b07e-c856682fb167 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.704723 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c63f2-474b-41ca-b07e-c856682fb167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.732429 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-573c63f2-474b-41ca-b07e-c856682fb167 None None] MFA Rules not processed for user `ce5d62b34c994753bef7ced63901819a`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:29.733785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-573c63f2-474b-41ca-b07e-c856682fb167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:29.805204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1398/2776] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:29.816872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b5e22-3d50-48ee-9d8e-e9ccf3db0ee2 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:29.818687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5e1b5e22-3d50-48ee-9d8e-e9ccf3db0ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:29.892853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b5e22-3d50-48ee-9d8e-e9ccf3db0ee2 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:29.899813 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1a769-7cf3-49d1-af34-d962baa056a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:29.900806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a769-7cf3-49d1-af34-d962baa056a0 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:29.901160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a769-7cf3-49d1-af34-d962baa056a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:29.901501 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a769-7cf3-49d1-af34-d962baa056a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:29.914796 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1a769-7cf3-49d1-af34-d962baa056a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:29.916507 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1a769-7cf3-49d1-af34-d962baa056a0 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:29.932394 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1379/2777] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:32.445638 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c63f2-474b-41ca-b07e-c856682fb167 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:32.447485 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-573c63f2-474b-41ca-b07e-c856682fb167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:32.535675 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c63f2-474b-41ca-b07e-c856682fb167 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:32.540843 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:32.541789 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:32.542073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:32.542382 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] PATH_INFO: `/v3/users/de7064b7c7cf4bf0948e6e1fc8312f8b` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:32.543658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7064b7c7cf4bf0948e6e1fc8312f8b)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:32.545642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:32.610416 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7064b7c7cf4bf0948e6e1fc8312f8b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:32.623886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7064b7c7cf4bf0948e6e1fc8312f8b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:32.624668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7064b7c7cf4bf0948e6e1fc8312f8b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:32.636078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7064b7c7cf4bf0948e6e1fc8312f8b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:32.651184 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7064b7c7cf4bf0948e6e1fc8312f8b'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:32.660304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1399/2778] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:32 2022] DELETE /identity/v3/users/de7064b7c7cf4bf0948e6e1fc8312f8b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:32.665066 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9226c1-636f-410c-8b22-c83f34fef7c9 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:32.665599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9226c1-636f-410c-8b22-c83f34fef7c9 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:32.665717 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9226c1-636f-410c-8b22-c83f34fef7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:32.699376 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-9f9226c1-636f-410c-8b22-c83f34fef7c9 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:32.701994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9f9226c1-636f-410c-8b22-c83f34fef7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:32.789543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1380/2779] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:32.801204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:32.803522 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:32.903579 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7b255-1b7b-4406-9374-811232cc2d48 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:32.910013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384abc01-3f49-4603-8ec2-0199eb19e811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:32.916644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384abc01-3f49-4603-8ec2-0199eb19e811 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:32.916644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384abc01-3f49-4603-8ec2-0199eb19e811 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:32.916644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384abc01-3f49-4603-8ec2-0199eb19e811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:32.944848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384abc01-3f49-4603-8ec2-0199eb19e811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:32.946329 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384abc01-3f49-4603-8ec2-0199eb19e811 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:32.957840 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1400/2780] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:33.358954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9226c1-636f-410c-8b22-c83f34fef7c9 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:33.361159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9f9226c1-636f-410c-8b22-c83f34fef7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:33.381877 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9226c1-636f-410c-8b22-c83f34fef7c9 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:33.391127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:33.392886 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:33.393266 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:33.393755 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] PATH_INFO: `/v3/projects/27f6acecbd5f4fc68157db9fef027706` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:33.395693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f6acecbd5f4fc68157db9fef027706)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:33.398333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:33.459248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f6acecbd5f4fc68157db9fef027706', 'request_id': 'req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:33.466377 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f6acecbd5f4fc68157db9fef027706', 'request_id': 'req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:33.476294 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f6acecbd5f4fc68157db9fef027706', 'request_id': 'req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:33.488082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] The token cache is being invalidate because project 27f6acecbd5f4fc68157db9fef027706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:33.488374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:33.489046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:33.490633 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1381/2781] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:33 2022] DELETE /identity/v3/projects/27f6acecbd5f4fc68157db9fef027706 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:33.494983 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384abc01-3f49-4603-8ec2-0199eb19e811 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:33.505353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384abc01-3f49-4603-8ec2-0199eb19e811 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:33.575394 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:33.576320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:33.576600 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:33.576873 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] PATH_INFO: `/v3/users/9d4e02f82cf84ac68a40f627c076bdeb` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:33.578140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4e02f82cf84ac68a40f627c076bdeb)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:33.580922 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:33.638463 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4e02f82cf84ac68a40f627c076bdeb'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:33.653243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4e02f82cf84ac68a40f627c076bdeb'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:33.654410 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4e02f82cf84ac68a40f627c076bdeb'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:33.667661 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4e02f82cf84ac68a40f627c076bdeb'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:33.678441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4e02f82cf84ac68a40f627c076bdeb'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:33.687980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1401/2782] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:33 2022] DELETE /identity/v3/users/9d4e02f82cf84ac68a40f627c076bdeb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:34.020201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:34.021654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:34.036821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cde9e5-d3f4-4837-9731-fe7d1d306ac1 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:34.124831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:34.124831 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:34.125338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:34.125338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] PATH_INFO: `/v3/projects/273c9fa70a814f9eb28488e29751116a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:34.126894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=273c9fa70a814f9eb28488e29751116a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:34.129520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:34.214924 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273c9fa70a814f9eb28488e29751116a', 'request_id': 'req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.224888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273c9fa70a814f9eb28488e29751116a', 'request_id': 'req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.235186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273c9fa70a814f9eb28488e29751116a', 'request_id': 'req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.250234 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] The token cache is being invalidate because project 273c9fa70a814f9eb28488e29751116a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:34.250614 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.251583 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.254218 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1382/2783] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:34 2022] DELETE /identity/v3/projects/273c9fa70a814f9eb28488e29751116a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:34.259041 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:34.261254 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:34.280534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0548a-f3a5-4c3d-bcfa-fd2e7fe241ac admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:34.356370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8a061-5513-4b4a-b8b0-8bfbf9efa892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:34.357261 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8a061-5513-4b4a-b8b0-8bfbf9efa892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:34.357542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8a061-5513-4b4a-b8b0-8bfbf9efa892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:34.357820 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8a061-5513-4b4a-b8b0-8bfbf9efa892 admin admin] PATH_INFO: `/v3/users/9b07e464f6f7467aa81515af5d18f916` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:34.359055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8a061-5513-4b4a-b8b0-8bfbf9efa892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b07e464f6f7467aa81515af5d18f916)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:34.361823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8a061-5513-4b4a-b8b0-8bfbf9efa892 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:34.415530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e8c8a061-5513-4b4a-b8b0-8bfbf9efa892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b07e464f6f7467aa81515af5d18f916'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.431461 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e8c8a061-5513-4b4a-b8b0-8bfbf9efa892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b07e464f6f7467aa81515af5d18f916'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.433274 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e8c8a061-5513-4b4a-b8b0-8bfbf9efa892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b07e464f6f7467aa81515af5d18f916'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.443796 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e8c8a061-5513-4b4a-b8b0-8bfbf9efa892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b07e464f6f7467aa81515af5d18f916'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.452381 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-e8c8a061-5513-4b4a-b8b0-8bfbf9efa892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b07e464f6f7467aa81515af5d18f916'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.459091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1402/2784] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:34 2022] DELETE /identity/v3/users/9b07e464f6f7467aa81515af5d18f916 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:34.768029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:34.769445 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:34.781727 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683ce8b-179d-43b4-8d38-a13a5d8e9c06 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:34.840150 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:34.841259 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:34.841538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:34.841812 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] PATH_INFO: `/v3/projects/27170d9c0e10445bb5014bf73bde8664` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:34.842985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27170d9c0e10445bb5014bf73bde8664)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:34.844910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:34.891259 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27170d9c0e10445bb5014bf73bde8664', 'request_id': 'req-371d98d1-af43-43be-8221-ff11336a75b2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.897255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27170d9c0e10445bb5014bf73bde8664', 'request_id': 'req-371d98d1-af43-43be-8221-ff11336a75b2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.904525 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27170d9c0e10445bb5014bf73bde8664', 'request_id': 'req-371d98d1-af43-43be-8221-ff11336a75b2'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.914957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] The token cache is being invalidate because project 27170d9c0e10445bb5014bf73bde8664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:34.915238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.915905 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-371d98d1-af43-43be-8221-ff11336a75b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:34.917454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1383/2785] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:34 2022] DELETE /identity/v3/projects/27170d9c0e10445bb5014bf73bde8664 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:34.923987 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0880887-50db-4c73-b3aa-d3e4a3a941b4 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:34.924460 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0880887-50db-4c73-b3aa-d3e4a3a941b4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:34.924593 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0880887-50db-4c73-b3aa-d3e4a3a941b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:34.943227 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-f0880887-50db-4c73-b3aa-d3e4a3a941b4 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:34.944493 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-f0880887-50db-4c73-b3aa-d3e4a3a941b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:35.004164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1403/2786] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:35.012352 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c21c3-434a-48ed-a2aa-2511ffeb6c37 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:35.012649 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c21c3-434a-48ed-a2aa-2511ffeb6c37 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:35.012940 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c21c3-434a-48ed-a2aa-2511ffeb6c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:35.033255 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-226c21c3-434a-48ed-a2aa-2511ffeb6c37 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:35.035145 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-226c21c3-434a-48ed-a2aa-2511ffeb6c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:35.043754 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1384/2787] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:35.047967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0880887-50db-4c73-b3aa-d3e4a3a941b4 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:35.058529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0880887-50db-4c73-b3aa-d3e4a3a941b4 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:35.063103 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf70110-b449-4132-a582-286d4e5a3baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:35.063832 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf70110-b449-4132-a582-286d4e5a3baf admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:35.064400 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf70110-b449-4132-a582-286d4e5a3baf admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:35.065190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf70110-b449-4132-a582-286d4e5a3baf admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:35.065947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf70110-b449-4132-a582-286d4e5a3baf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:35.066258 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf70110-b449-4132-a582-286d4e5a3baf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:35.067852 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf70110-b449-4132-a582-286d4e5a3baf admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:35.079572 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1404/2788] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:57:35.084037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4612a-56b2-4a72-9ddd-aabb39336186 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:35.084315 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf70110-b449-4132-a582-286d4e5a3baf admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:35.084430 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4612a-56b2-4a72-9ddd-aabb39336186 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:35.084619 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4612a-56b2-4a72-9ddd-aabb39336186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:35.094504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf70110-b449-4132-a582-286d4e5a3baf admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:35.100806 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d98086-9bad-4fe7-ae5a-03f0cf93de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:35.101502 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d98086-9bad-4fe7-ae5a-03f0cf93de32 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:35.101779 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d98086-9bad-4fe7-ae5a-03f0cf93de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:35.102049 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d98086-9bad-4fe7-ae5a-03f0cf93de32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:35.102851 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d98086-9bad-4fe7-ae5a-03f0cf93de32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:35.103368 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-74a4612a-56b2-4a72-9ddd-aabb39336186 None None] MFA Rules not processed for user `5e9ebfaac4984817bb768476ef74445c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:35.104652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-74a4612a-56b2-4a72-9ddd-aabb39336186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:35.104910 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d98086-9bad-4fe7-ae5a-03f0cf93de32 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:35.132504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1405/2789] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:35 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:35.136984 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d98086-9bad-4fe7-ae5a-03f0cf93de32 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:35.161434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1385/2790] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:35.199933 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d98086-9bad-4fe7-ae5a-03f0cf93de32 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:35.205043 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84f22a-fd4b-44b0-98b2-707e5c229cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:35.205718 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f22a-fd4b-44b0-98b2-707e5c229cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:35.205976 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f22a-fd4b-44b0-98b2-707e5c229cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:35.206251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f22a-fd4b-44b0-98b2-707e5c229cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:35.207059 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84f22a-fd4b-44b0-98b2-707e5c229cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:35.208997 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84f22a-fd4b-44b0-98b2-707e5c229cf9 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:35.234780 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1406/2791] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:35 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:57:35.236334 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4612a-56b2-4a72-9ddd-aabb39336186 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:35.249191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4612a-56b2-4a72-9ddd-aabb39336186 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:35.262495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfd3ee-fb67-4e0a-813b-512f06672325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:35.263183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfd3ee-fb67-4e0a-813b-512f06672325 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:35.263543 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfd3ee-fb67-4e0a-813b-512f06672325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:35.263783 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfd3ee-fb67-4e0a-813b-512f06672325 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:35.264495 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfd3ee-fb67-4e0a-813b-512f06672325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:35.266138 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfd3ee-fb67-4e0a-813b-512f06672325 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:35.277114 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1386/2792] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:57:35.280706 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84f22a-fd4b-44b0-98b2-707e5c229cf9 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:35.291379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84f22a-fd4b-44b0-98b2-707e5c229cf9 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:35.305000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37604db-b756-438f-8e3e-ccca582f070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:35.305000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37604db-b756-438f-8e3e-ccca582f070d admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:35.305000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37604db-b756-438f-8e3e-ccca582f070d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:35.305000 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37604db-b756-438f-8e3e-ccca582f070d admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:35.305791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37604db-b756-438f-8e3e-ccca582f070d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:35.305791 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37604db-b756-438f-8e3e-ccca582f070d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:35.319061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1407/2793] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:35.323077 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfd3ee-fb67-4e0a-813b-512f06672325 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:35.338213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfd3ee-fb67-4e0a-813b-512f06672325 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:35.343404 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50912201-dfd9-4355-bca8-f2a1df25520d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:35.344380 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50912201-dfd9-4355-bca8-f2a1df25520d admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:35.344665 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50912201-dfd9-4355-bca8-f2a1df25520d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:35.344942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50912201-dfd9-4355-bca8-f2a1df25520d admin admin] PATH_INFO: `/v3/projects/2245b817988a4657b4dea4fa53129616/users/0a076643afb44f099eec583d80779d0d/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:35.370254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50912201-dfd9-4355-bca8-f2a1df25520d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2245b817988a4657b4dea4fa53129616, user_id=0a076643afb44f099eec583d80779d0d, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:35.373786 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50912201-dfd9-4355-bca8-f2a1df25520d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:35.395191 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1387/2794] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:35 2022] PUT /identity/v3/projects/2245b817988a4657b4dea4fa53129616/users/0a076643afb44f099eec583d80779d0d/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:35.412637 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f42eb-9643-4e06-95ce-2679d6c988c4 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:35.413275 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f42eb-9643-4e06-95ce-2679d6c988c4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:35.413459 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f42eb-9643-4e06-95ce-2679d6c988c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:35.447629 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-cd7f42eb-9643-4e06-95ce-2679d6c988c4 None None] MFA Rules not processed for user `0a076643afb44f099eec583d80779d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:35.449302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-cd7f42eb-9643-4e06-95ce-2679d6c988c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:35.523310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1408/2795] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:35.535360 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50912201-dfd9-4355-bca8-f2a1df25520d admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:35.538283 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-50912201-dfd9-4355-bca8-f2a1df25520d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:35.602948 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50912201-dfd9-4355-bca8-f2a1df25520d admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:35.609242 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5e74a-2d7d-4e3c-86ca-1dae17b7aac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:35.609969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5e74a-2d7d-4e3c-86ca-1dae17b7aac9 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:35.610314 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5e74a-2d7d-4e3c-86ca-1dae17b7aac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:35.610600 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5e74a-2d7d-4e3c-86ca-1dae17b7aac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:35.619632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5e74a-2d7d-4e3c-86ca-1dae17b7aac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:35.620953 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5e74a-2d7d-4e3c-86ca-1dae17b7aac9 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:35.630669 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1388/2796] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:39.103781 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f42eb-9643-4e06-95ce-2679d6c988c4 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:39.206909 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f42eb-9643-4e06-95ce-2679d6c988c4 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:39.216412 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:39.218235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:39.218878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:39.219703 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] PATH_INFO: `/v3/users/0a076643afb44f099eec583d80779d0d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:39.223509 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a076643afb44f099eec583d80779d0d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:39.231127 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:39.345494 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a076643afb44f099eec583d80779d0d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:39.366491 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a076643afb44f099eec583d80779d0d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:39.367327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a076643afb44f099eec583d80779d0d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:39.377403 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a076643afb44f099eec583d80779d0d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:39.385644 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a076643afb44f099eec583d80779d0d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:39.392984 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1409/2797] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:57:39 2022] DELETE /identity/v3/users/0a076643afb44f099eec583d80779d0d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:57:39.397865 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb57d-53a6-4540-93ee-5421140ca214 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:39.398542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb57d-53a6-4540-93ee-5421140ca214 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:39.398542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb57d-53a6-4540-93ee-5421140ca214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:39.420696 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-51dbb57d-53a6-4540-93ee-5421140ca214 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:39.421921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-51dbb57d-53a6-4540-93ee-5421140ca214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:39.503316 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1389/2798] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:39.514124 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:39.515689 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:39.586208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dbbb1-6e99-4ada-bd33-bcf7b9122014 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:39.589795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa5076-bcd3-4ded-8d99-caacd4c6463e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:39.590443 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa5076-bcd3-4ded-8d99-caacd4c6463e service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:39.590979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa5076-bcd3-4ded-8d99-caacd4c6463e service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:39.591253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa5076-bcd3-4ded-8d99-caacd4c6463e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:39.603010 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa5076-bcd3-4ded-8d99-caacd4c6463e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:39.604564 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa5076-bcd3-4ded-8d99-caacd4c6463e service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:39.616222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1410/2799] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:39.988536 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbb57d-53a6-4540-93ee-5421140ca214 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:39.990133 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-51dbb57d-53a6-4540-93ee-5421140ca214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:40.010535 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbb57d-53a6-4540-93ee-5421140ca214 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:40.017675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:40.018584 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:40.018884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:40.019147 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] PATH_INFO: `/v3/projects/2245b817988a4657b4dea4fa53129616` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:40.020412 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2245b817988a4657b4dea4fa53129616)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:40.022571 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:40.081354 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2245b817988a4657b4dea4fa53129616', 'request_id': 'req-4c167be8-c02d-4a15-a9e5-38a090fcab55'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:40.092934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2245b817988a4657b4dea4fa53129616', 'request_id': 'req-4c167be8-c02d-4a15-a9e5-38a090fcab55'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:40.108629 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2245b817988a4657b4dea4fa53129616', 'request_id': 'req-4c167be8-c02d-4a15-a9e5-38a090fcab55'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:40.122433 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] The token cache is being invalidate because project 2245b817988a4657b4dea4fa53129616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:57:40.122721 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:40.123384 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4c167be8-c02d-4a15-a9e5-38a090fcab55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:57:40.124985 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1390/2800] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:57:39 2022] DELETE /identity/v3/projects/2245b817988a4657b4dea4fa53129616 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:40.132369 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e6b77-c548-437a-bd9f-5d8b57d84927 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:40.133228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e6b77-c548-437a-bd9f-5d8b57d84927 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:40.133228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e6b77-c548-437a-bd9f-5d8b57d84927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:40.162470 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-f75e6b77-c548-437a-bd9f-5d8b57d84927 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:40.164705 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-f75e6b77-c548-437a-bd9f-5d8b57d84927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:40.234883 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1411/2801] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:40.248126 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3e07-4641-45fe-9264-0e8ff4a48dd6 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:40.248646 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3e07-4641-45fe-9264-0e8ff4a48dd6 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:40.249098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3e07-4641-45fe-9264-0e8ff4a48dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:40.280473 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-ec3d3e07-4641-45fe-9264-0e8ff4a48dd6 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:40.283060 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ec3d3e07-4641-45fe-9264-0e8ff4a48dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:40.297193 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1391/2802] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:40.306867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e6b77-c548-437a-bd9f-5d8b57d84927 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:40.321332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e6b77-c548-437a-bd9f-5d8b57d84927 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:40.326668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c52b97-2d7f-4d07-b1de-345b226e8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:40.327327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c52b97-2d7f-4d07-b1de-345b226e8998 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:40.327610 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c52b97-2d7f-4d07-b1de-345b226e8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:40.327916 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c52b97-2d7f-4d07-b1de-345b226e8998 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:40.328672 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c52b97-2d7f-4d07-b1de-345b226e8998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:57:40.328981 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c52b97-2d7f-4d07-b1de-345b226e8998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:40.330836 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c52b97-2d7f-4d07-b1de-345b226e8998 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:40.343495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1412/2803] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:57:40.348874 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d3e07-4641-45fe-9264-0e8ff4a48dd6 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:40.363174 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d3e07-4641-45fe-9264-0e8ff4a48dd6 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:40.369098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2e13e-bf85-49b5-a599-12bff52ead15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:40.370281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2e13e-bf85-49b5-a599-12bff52ead15 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:40.370281 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2e13e-bf85-49b5-a599-12bff52ead15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:40.370485 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2e13e-bf85-49b5-a599-12bff52ead15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:40.371026 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2e13e-bf85-49b5-a599-12bff52ead15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:40.372972 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2e13e-bf85-49b5-a599-12bff52ead15 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:40.411211 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1392/2804] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:57:40 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:40.416751 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c52b97-2d7f-4d07-b1de-345b226e8998 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:40.435453 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c52b97-2d7f-4d07-b1de-345b226e8998 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:40.516650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140f8dc-a365-4658-a9e8-bb77a2aa447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:40.517905 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140f8dc-a365-4658-a9e8-bb77a2aa447d admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:40.518310 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140f8dc-a365-4658-a9e8-bb77a2aa447d admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:40.518815 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140f8dc-a365-4658-a9e8-bb77a2aa447d admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:40.519542 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140f8dc-a365-4658-a9e8-bb77a2aa447d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:40.521541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140f8dc-a365-4658-a9e8-bb77a2aa447d admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:40.544061 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1413/2805] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:57:40 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:57:40.548645 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2e13e-bf85-49b5-a599-12bff52ead15 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:40.566337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2e13e-bf85-49b5-a599-12bff52ead15 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:40.571371 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88308bf4-4174-4993-93a3-1cf06db2fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:40.572095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308bf4-4174-4993-93a3-1cf06db2fe6d admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:40.572379 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308bf4-4174-4993-93a3-1cf06db2fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:40.572685 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308bf4-4174-4993-93a3-1cf06db2fe6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:40.573434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88308bf4-4174-4993-93a3-1cf06db2fe6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:40.575049 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88308bf4-4174-4993-93a3-1cf06db2fe6d admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:40.586795 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1393/2806] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:40.591192 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140f8dc-a365-4658-a9e8-bb77a2aa447d admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:40.603302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140f8dc-a365-4658-a9e8-bb77a2aa447d admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:40.608252 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca991c-1d1c-4e1e-be03-83321d87a333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:40.608927 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca991c-1d1c-4e1e-be03-83321d87a333 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:40.609206 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca991c-1d1c-4e1e-be03-83321d87a333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:40.609477 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca991c-1d1c-4e1e-be03-83321d87a333 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:40.610214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca991c-1d1c-4e1e-be03-83321d87a333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:40.612544 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca991c-1d1c-4e1e-be03-83321d87a333 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:40.622978 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1414/2807] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:57:40.627518 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88308bf4-4174-4993-93a3-1cf06db2fe6d admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:40.637835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88308bf4-4174-4993-93a3-1cf06db2fe6d admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:40.646500 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42563281-fe97-48ce-b6ce-fa1531764147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:40.647423 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42563281-fe97-48ce-b6ce-fa1531764147 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:40.647732 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42563281-fe97-48ce-b6ce-fa1531764147 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:40.648024 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42563281-fe97-48ce-b6ce-fa1531764147 admin admin] PATH_INFO: `/v3/projects/f9efeff69f9f4234848b83b130995dfd/users/de2ca7bb4e984ed182a2ea91af2f4639/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:40.664558 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42563281-fe97-48ce-b6ce-fa1531764147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9efeff69f9f4234848b83b130995dfd, user_id=de2ca7bb4e984ed182a2ea91af2f4639, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:40.667265 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42563281-fe97-48ce-b6ce-fa1531764147 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:40.682215 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1394/2808] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:57:40 2022] PUT /identity/v3/projects/f9efeff69f9f4234848b83b130995dfd/users/de2ca7bb4e984ed182a2ea91af2f4639/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:57:40.694714 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e256b-c0d6-4e5d-9d05-445a471b010d None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:40.695001 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e256b-c0d6-4e5d-9d05-445a471b010d None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:40.695283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e256b-c0d6-4e5d-9d05-445a471b010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:40.728713 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-832e256b-c0d6-4e5d-9d05-445a471b010d None None] MFA Rules not processed for user `de2ca7bb4e984ed182a2ea91af2f4639`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:57:40.730529 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-832e256b-c0d6-4e5d-9d05-445a471b010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:40.812028 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1415/2809] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:57:40.823921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42563281-fe97-48ce-b6ce-fa1531764147 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:40.825681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-42563281-fe97-48ce-b6ce-fa1531764147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:40.891903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42563281-fe97-48ce-b6ce-fa1531764147 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:40.906051 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2875b7a-ebd1-45b4-95a4-78d3b073d7ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0e623c10804239a076fc6cde9b198d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:40.907071 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2875b7a-ebd1-45b4-95a4-78d3b073d7ad service glance] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:40.907902 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2875b7a-ebd1-45b4-95a4-78d3b073d7ad service glance] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:40.908226 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2875b7a-ebd1-45b4-95a4-78d3b073d7ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:40.919216 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2875b7a-ebd1-45b4-95a4-78d3b073d7ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:40.920724 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2875b7a-ebd1-45b4-95a4-78d3b073d7ad service glance] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:40.931753 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1395/2810] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:57:58.567105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e256b-c0d6-4e5d-9d05-445a471b010d None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:57:58.568833 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-832e256b-c0d6-4e5d-9d05-445a471b010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:58.660302 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e256b-c0d6-4e5d-9d05-445a471b010d None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:57:58.666027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27c869-7255-44d0-849c-6cc5ca4603a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:57:58.667081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27c869-7255-44d0-849c-6cc5ca4603a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:57:58.667524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27c869-7255-44d0-849c-6cc5ca4603a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:57:58.668040 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27c869-7255-44d0-849c-6cc5ca4603a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:57:58.670808 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4d27c869-7255-44d0-849c-6cc5ca4603a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:57:58.751073 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27c869-7255-44d0-849c-6cc5ca4603a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:57:58.752435 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27c869-7255-44d0-849c-6cc5ca4603a5 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:57:58.762663 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1416/2811] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:57:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:58:33.262137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2875b7a-ebd1-45b4-95a4-78d3b073d7ad service glance] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:33.263574 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f2875b7a-ebd1-45b4-95a4-78d3b073d7ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:33.372772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2875b7a-ebd1-45b4-95a4-78d3b073d7ad service glance] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:33.380338 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:33.381235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:33.381520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:33.381798 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] PATH_INFO: `/v3/users/ce5d62b34c994753bef7ced63901819a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:33.383106 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5d62b34c994753bef7ced63901819a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:33.385213 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:33.440787 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5d62b34c994753bef7ced63901819a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:33.454671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5d62b34c994753bef7ced63901819a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:33.455168 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5d62b34c994753bef7ced63901819a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:33.455994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5d62b34c994753bef7ced63901819a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:33.464097 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5d62b34c994753bef7ced63901819a'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:33.480832 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1396/2812] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:58:33 2022] DELETE /identity/v3/users/ce5d62b34c994753bef7ced63901819a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:58:33.485947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c781-059d-4fcd-9e58-b6186deede61 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:33.486511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c781-059d-4fcd-9e58-b6186deede61 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:33.486511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745c781-059d-4fcd-9e58-b6186deede61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:33.507957 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-2745c781-059d-4fcd-9e58-b6186deede61 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:33.509363 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2745c781-059d-4fcd-9e58-b6186deede61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:33.589812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1417/2813] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:58:33.600369 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:33.601827 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:33.685945 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9a9e6-2edc-4573-9af8-f61793fb0d3b admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:33.690702 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f5a1e-f002-4d59-87a6-c9189cf79b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:33.691244 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f5a1e-f002-4d59-87a6-c9189cf79b6a service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:33.691556 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f5a1e-f002-4d59-87a6-c9189cf79b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:33.691871 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f5a1e-f002-4d59-87a6-c9189cf79b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:33.702254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f5a1e-f002-4d59-87a6-c9189cf79b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:33.703772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f5a1e-f002-4d59-87a6-c9189cf79b6a service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:33.719648 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1397/2814] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:58:33.948337 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c781-059d-4fcd-9e58-b6186deede61 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:33.950235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-2745c781-059d-4fcd-9e58-b6186deede61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:33.963858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745c781-059d-4fcd-9e58-b6186deede61 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:33.969884 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0bc33-192a-4a3c-b68f-d5c82f295404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:33.970862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0bc33-192a-4a3c-b68f-d5c82f295404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:33.971210 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0bc33-192a-4a3c-b68f-d5c82f295404 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:33.971551 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0bc33-192a-4a3c-b68f-d5c82f295404 admin admin] PATH_INFO: `/v3/users/de2ca7bb4e984ed182a2ea91af2f4639` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:33.972979 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0bc33-192a-4a3c-b68f-d5c82f295404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2ca7bb4e984ed182a2ea91af2f4639)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:33.975015 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0bc33-192a-4a3c-b68f-d5c82f295404 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:34.035572 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-34e0bc33-192a-4a3c-b68f-d5c82f295404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2ca7bb4e984ed182a2ea91af2f4639'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.052173 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-34e0bc33-192a-4a3c-b68f-d5c82f295404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2ca7bb4e984ed182a2ea91af2f4639'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.053703 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-34e0bc33-192a-4a3c-b68f-d5c82f295404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2ca7bb4e984ed182a2ea91af2f4639'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.053942 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f5a1e-f002-4d59-87a6-c9189cf79b6a service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:34.055596 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9f9f5a1e-f002-4d59-87a6-c9189cf79b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:34.067763 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-34e0bc33-192a-4a3c-b68f-d5c82f295404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2ca7bb4e984ed182a2ea91af2f4639'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.075690 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-34e0bc33-192a-4a3c-b68f-d5c82f295404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2ca7bb4e984ed182a2ea91af2f4639'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.087793 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1418/2815] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:58:33 2022] DELETE /identity/v3/users/de2ca7bb4e984ed182a2ea91af2f4639 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:58:34.096066 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b4e2c-4e6f-42c2-86d6-9e8c658679f4 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:34.096801 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b4e2c-4e6f-42c2-86d6-9e8c658679f4 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:34.097091 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b4e2c-4e6f-42c2-86d6-9e8c658679f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:34.108247 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f5a1e-f002-4d59-87a6-c9189cf79b6a service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:34.128195 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-8c3b4e2c-4e6f-42c2-86d6-9e8c658679f4 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:34.129537 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8c3b4e2c-4e6f-42c2-86d6-9e8c658679f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:34.196684 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:34.197999 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:34.198857 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:34.199344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] PATH_INFO: `/v3/projects/960412c282f44c8693402a1469c9c313` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:34.201486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960412c282f44c8693402a1469c9c313)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:34.205785 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:34.220105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1419/2816] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:58:34.234204 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b4e2c-4e6f-42c2-86d6-9e8c658679f4 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:34.235956 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-8c3b4e2c-4e6f-42c2-86d6-9e8c658679f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:34.283520 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960412c282f44c8693402a1469c9c313', 'request_id': 'req-76197caa-8a4e-4639-a28d-e284f8dd9395'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.295342 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960412c282f44c8693402a1469c9c313', 'request_id': 'req-76197caa-8a4e-4639-a28d-e284f8dd9395'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.306675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960412c282f44c8693402a1469c9c313', 'request_id': 'req-76197caa-8a4e-4639-a28d-e284f8dd9395'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.319430 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b4e2c-4e6f-42c2-86d6-9e8c658679f4 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:34.330699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] The token cache is being invalidate because project 960412c282f44c8693402a1469c9c313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:58:34.331144 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.331943 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.333965 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1398/2817] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:58:34 2022] DELETE /identity/v3/projects/960412c282f44c8693402a1469c9c313 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 18:58:34.399287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf817d-4e02-4de8-98aa-6e9866fc7346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:34.400077 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf817d-4e02-4de8-98aa-6e9866fc7346 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:34.400272 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf817d-4e02-4de8-98aa-6e9866fc7346 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:34.400510 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf817d-4e02-4de8-98aa-6e9866fc7346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:34.402782 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b3cf817d-4e02-4de8-98aa-6e9866fc7346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:34.493150 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf817d-4e02-4de8-98aa-6e9866fc7346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:34.495504 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf817d-4e02-4de8-98aa-6e9866fc7346 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:34.513240 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1420/2818] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:58:34.828020 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:34.830296 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:34.848766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76197caa-8a4e-4639-a28d-e284f8dd9395 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:34.853947 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:34.854833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:34.855127 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:34.855436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] PATH_INFO: `/v3/projects/f9efeff69f9f4234848b83b130995dfd` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:34.856691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9efeff69f9f4234848b83b130995dfd)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:34.859183 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:34.929910 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9efeff69f9f4234848b83b130995dfd', 'request_id': 'req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.938198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9efeff69f9f4234848b83b130995dfd', 'request_id': 'req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.947699 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9efeff69f9f4234848b83b130995dfd', 'request_id': 'req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.962459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] The token cache is being invalidate because project f9efeff69f9f4234848b83b130995dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:58:34.962819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.963409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-0aca8ae0-ff36-41b4-b83d-32076dcfacf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:34.965007 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1399/2819] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:58:34 2022] DELETE /identity/v3/projects/f9efeff69f9f4234848b83b130995dfd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:58:34.970980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094f8ff-03e5-4291-a3a9-91c5ff010cb9 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:34.971282 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094f8ff-03e5-4291-a3a9-91c5ff010cb9 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:34.971539 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094f8ff-03e5-4291-a3a9-91c5ff010cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:34.993217 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-4094f8ff-03e5-4291-a3a9-91c5ff010cb9 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:34.994940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-4094f8ff-03e5-4291-a3a9-91c5ff010cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:35.069541 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1421/2820] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:58:35.077691 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee972e37-3586-4aa0-9b71-27647ad24011 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.078009 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee972e37-3586-4aa0-9b71-27647ad24011 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.078472 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee972e37-3586-4aa0-9b71-27647ad24011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.098559 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-ee972e37-3586-4aa0-9b71-27647ad24011 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:35.099918 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-ee972e37-3586-4aa0-9b71-27647ad24011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:35.108098 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1400/2821] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:58:35.113298 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094f8ff-03e5-4291-a3a9-91c5ff010cb9 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:35.123256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094f8ff-03e5-4291-a3a9-91c5ff010cb9 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:35.128895 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcd933-dd5d-4b4f-92f2-9924b0800e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:35.129570 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcd933-dd5d-4b4f-92f2-9924b0800e2c admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.129850 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcd933-dd5d-4b4f-92f2-9924b0800e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.130130 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcd933-dd5d-4b4f-92f2-9924b0800e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.130878 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcd933-dd5d-4b4f-92f2-9924b0800e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:35.131190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcd933-dd5d-4b4f-92f2-9924b0800e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:35.132830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcd933-dd5d-4b4f-92f2-9924b0800e2c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:35.145224 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1422/2822] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:35.150019 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee972e37-3586-4aa0-9b71-27647ad24011 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:35.160263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee972e37-3586-4aa0-9b71-27647ad24011 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:35.165804 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a5ff5-2f21-46df-a2a3-f01204b886c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:35.166130 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a5ff5-2f21-46df-a2a3-f01204b886c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.166425 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a5ff5-2f21-46df-a2a3-f01204b886c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.166697 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a5ff5-2f21-46df-a2a3-f01204b886c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.167654 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a5ff5-2f21-46df-a2a3-f01204b886c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:35.169364 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a5ff5-2f21-46df-a2a3-f01204b886c4 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:35.202917 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1401/2823] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:58:35 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:58:35.209105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcd933-dd5d-4b4f-92f2-9924b0800e2c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:35.219859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcd933-dd5d-4b4f-92f2-9924b0800e2c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:35.279264 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfbfcd-af1c-4187-a35d-35a7b71a9198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:35.279977 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfbfcd-af1c-4187-a35d-35a7b71a9198 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.280261 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfbfcd-af1c-4187-a35d-35a7b71a9198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.281069 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfbfcd-af1c-4187-a35d-35a7b71a9198 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.282347 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfbfcd-af1c-4187-a35d-35a7b71a9198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:35.284354 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfbfcd-af1c-4187-a35d-35a7b71a9198 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:35.305614 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1423/2824] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:58:35 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 18:58:35.309190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a5ff5-2f21-46df-a2a3-f01204b886c4 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:35.321852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a5ff5-2f21-46df-a2a3-f01204b886c4 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:35.326586 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d02a1-cfbc-4767-badd-2b712bc69c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:35.327321 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d02a1-cfbc-4767-badd-2b712bc69c39 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.328811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d02a1-cfbc-4767-badd-2b712bc69c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.328811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d02a1-cfbc-4767-badd-2b712bc69c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.329462 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d02a1-cfbc-4767-badd-2b712bc69c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:35.331143 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d02a1-cfbc-4767-badd-2b712bc69c39 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:35.342570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1402/2825] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:58:35.347226 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfbfcd-af1c-4187-a35d-35a7b71a9198 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:35.357908 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfbfcd-af1c-4187-a35d-35a7b71a9198 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:35.365524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd65223-f664-48a3-9605-ce282aa5c3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:35.366208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd65223-f664-48a3-9605-ce282aa5c3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.366489 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd65223-f664-48a3-9605-ce282aa5c3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.367327 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd65223-f664-48a3-9605-ce282aa5c3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.368365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd65223-f664-48a3-9605-ce282aa5c3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:35.369190 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd65223-f664-48a3-9605-ce282aa5c3e7 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:35.383051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1424/2826] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:58:35.388424 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d02a1-cfbc-4767-badd-2b712bc69c39 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:35.401819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d02a1-cfbc-4767-badd-2b712bc69c39 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:35.409436 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df25a8-93d5-4768-9918-77669a316669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:35.410829 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df25a8-93d5-4768-9918-77669a316669 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.411257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df25a8-93d5-4768-9918-77669a316669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.411683 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df25a8-93d5-4768-9918-77669a316669 admin admin] PATH_INFO: `/v3/projects/fcdead0c731540c997f3493902872775/users/ea57d4b7835e469a81f39994332fa08d/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.434440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df25a8-93d5-4768-9918-77669a316669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcdead0c731540c997f3493902872775, user_id=ea57d4b7835e469a81f39994332fa08d, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:35.437852 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df25a8-93d5-4768-9918-77669a316669 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:35.456716 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1403/2827] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:58:35 2022] PUT /identity/v3/projects/fcdead0c731540c997f3493902872775/users/ea57d4b7835e469a81f39994332fa08d/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:58:35.469943 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea1db7-07b4-4ba6-973b-93a3207970f8 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.470230 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea1db7-07b4-4ba6-973b-93a3207970f8 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.470510 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea1db7-07b4-4ba6-973b-93a3207970f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.498746 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-acea1db7-07b4-4ba6-973b-93a3207970f8 None None] MFA Rules not processed for user `ea57d4b7835e469a81f39994332fa08d`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:35.500370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-acea1db7-07b4-4ba6-973b-93a3207970f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:35.569482 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1425/2828] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:58:35.581613 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df25a8-93d5-4768-9918-77669a316669 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:35.583374 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-96df25a8-93d5-4768-9918-77669a316669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:35.646679 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df25a8-93d5-4768-9918-77669a316669 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:35.650435 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2003b33-ee4b-4799-aa86-6d0ae256a399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:35.651085 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2003b33-ee4b-4799-aa86-6d0ae256a399 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:35.651367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2003b33-ee4b-4799-aa86-6d0ae256a399 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:35.651643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2003b33-ee4b-4799-aa86-6d0ae256a399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:35.661811 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2003b33-ee4b-4799-aa86-6d0ae256a399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:35.663340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2003b33-ee4b-4799-aa86-6d0ae256a399 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:35.672957 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1404/2829] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:58:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:58:38.266186 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea1db7-07b4-4ba6-973b-93a3207970f8 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:38.326243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea1db7-07b4-4ba6-973b-93a3207970f8 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:38.330764 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:38.331623 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:38.331930 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:38.332202 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] PATH_INFO: `/v3/users/ea57d4b7835e469a81f39994332fa08d` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:38.333936 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea57d4b7835e469a81f39994332fa08d)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:38.335293 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:38.380970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea57d4b7835e469a81f39994332fa08d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:38.391311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea57d4b7835e469a81f39994332fa08d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:38.392010 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea57d4b7835e469a81f39994332fa08d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:38.400678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea57d4b7835e469a81f39994332fa08d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:38.408848 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea57d4b7835e469a81f39994332fa08d'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:38.414897 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1426/2830] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 18:58:38 2022] DELETE /identity/v3/users/ea57d4b7835e469a81f39994332fa08d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:58:38.422969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc41c1-16cd-467a-b91a-52a6fcb2fac5 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:38.422969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc41c1-16cd-467a-b91a-52a6fcb2fac5 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:38.422969 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc41c1-16cd-467a-b91a-52a6fcb2fac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:38.439580 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-9cbc41c1-16cd-467a-b91a-52a6fcb2fac5 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:38.440671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9cbc41c1-16cd-467a-b91a-52a6fcb2fac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:38.501222 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1405/2831] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:58:38.511636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:38.513160 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:38.581966 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77669f-5484-46d3-9a26-86ce31322d4c admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:38.586862 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9f749-6080-4399-9750-5fdf135af872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:38.587583 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9f749-6080-4399-9750-5fdf135af872 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:38.587820 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9f749-6080-4399-9750-5fdf135af872 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:38.588055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9f749-6080-4399-9750-5fdf135af872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:38.599464 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9f749-6080-4399-9750-5fdf135af872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:38.601365 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9f749-6080-4399-9750-5fdf135af872 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:38.614752 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1427/2832] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:58:38.889819 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc41c1-16cd-467a-b91a-52a6fcb2fac5 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:38.891238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-9cbc41c1-16cd-467a-b91a-52a6fcb2fac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:38.903238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc41c1-16cd-467a-b91a-52a6fcb2fac5 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:38.908333 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:38.909428 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:38.909715 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:38.909994 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] PATH_INFO: `/v3/projects/fcdead0c731540c997f3493902872775` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:38.914639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcdead0c731540c997f3493902872775)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:38.914639 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:38.963884 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcdead0c731540c997f3493902872775', 'request_id': 'req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:38.971795 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcdead0c731540c997f3493902872775', 'request_id': 'req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:38.980228 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcdead0c731540c997f3493902872775', 'request_id': 'req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:38.991866 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] The token cache is being invalidate because project fcdead0c731540c997f3493902872775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 18:58:38.992161 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:38.992833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4fabcadf-4521-487a-bb9d-cf2a65e3bc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 18:58:38.994418 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1406/2833] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 18:58:38 2022] DELETE /identity/v3/projects/fcdead0c731540c997f3493902872775 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:58:38.999804 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27488f8c-5fcf-4c01-a64a-7726c3b44bef None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:39.000092 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27488f8c-5fcf-4c01-a64a-7726c3b44bef None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:39.000372 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27488f8c-5fcf-4c01-a64a-7726c3b44bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:39.018664 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-27488f8c-5fcf-4c01-a64a-7726c3b44bef None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:39.019858 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-27488f8c-5fcf-4c01-a64a-7726c3b44bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:39.083442 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1428/2834] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:58:39.146465 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7845e37-5cfb-4a33-8462-9636fb710f8b None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:39.146784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7845e37-5cfb-4a33-8462-9636fb710f8b None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:39.147068 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7845e37-5cfb-4a33-8462-9636fb710f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:39.167878 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-d7845e37-5cfb-4a33-8462-9636fb710f8b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:39.169102 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-d7845e37-5cfb-4a33-8462-9636fb710f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:39.177888 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1407/2835] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:58:39.182353 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27488f8c-5fcf-4c01-a64a-7726c3b44bef None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:39.192648 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27488f8c-5fcf-4c01-a64a-7726c3b44bef None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:39.197235 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2545eef-3dfa-42bc-89ed-cbe10c79eeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:39.197900 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2545eef-3dfa-42bc-89ed-cbe10c79eeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:39.198178 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2545eef-3dfa-42bc-89ed-cbe10c79eeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:39.198448 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2545eef-3dfa-42bc-89ed-cbe10c79eeb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:39.199208 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2545eef-3dfa-42bc-89ed-cbe10c79eeb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 18:58:39.199512 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2545eef-3dfa-42bc-89ed-cbe10c79eeb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:39.201170 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2545eef-3dfa-42bc-89ed-cbe10c79eeb1 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:39.213575 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1429/2836] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 18:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 18:58:39.219046 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7845e37-5cfb-4a33-8462-9636fb710f8b None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:39.228908 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7845e37-5cfb-4a33-8462-9636fb710f8b None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:39.234620 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27764a35-d552-4732-b159-76852c84ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:39.235303 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27764a35-d552-4732-b159-76852c84ad20 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:39.235585 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27764a35-d552-4732-b159-76852c84ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:39.235903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27764a35-d552-4732-b159-76852c84ad20 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:39.236612 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27764a35-d552-4732-b159-76852c84ad20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:39.238515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27764a35-d552-4732-b159-76852c84ad20 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:39.264552 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1408/2837] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:58:39 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:58:39.269551 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2545eef-3dfa-42bc-89ed-cbe10c79eeb1 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:39.279530 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2545eef-3dfa-42bc-89ed-cbe10c79eeb1 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:39.338701 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a35989-c8af-498f-8896-d40719277940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:39.339376 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a35989-c8af-498f-8896-d40719277940 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:39.339658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a35989-c8af-498f-8896-d40719277940 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:39.339962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a35989-c8af-498f-8896-d40719277940 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:39.340926 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a35989-c8af-498f-8896-d40719277940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:39.343370 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a35989-c8af-498f-8896-d40719277940 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:39.364175 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1430/2838] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:58:39 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:58:39.368355 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27764a35-d552-4732-b159-76852c84ad20 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:39.378956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27764a35-d552-4732-b159-76852c84ad20 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:39.383661 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38134ed1-db50-49af-ab01-229f2d870407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:39.384367 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38134ed1-db50-49af-ab01-229f2d870407 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:39.384652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38134ed1-db50-49af-ab01-229f2d870407 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:39.384935 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38134ed1-db50-49af-ab01-229f2d870407 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:39.385662 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38134ed1-db50-49af-ab01-229f2d870407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:39.387276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38134ed1-db50-49af-ab01-229f2d870407 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:39.398833 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1409/2839] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 18:58:39.402886 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a35989-c8af-498f-8896-d40719277940 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:39.413516 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a35989-c8af-498f-8896-d40719277940 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:39.418104 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867b89f-9d7d-4826-8a08-196d3607ea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:39.418768 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867b89f-9d7d-4826-8a08-196d3607ea76 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:39.419051 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867b89f-9d7d-4826-8a08-196d3607ea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:39.419322 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867b89f-9d7d-4826-8a08-196d3607ea76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:39.420104 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867b89f-9d7d-4826-8a08-196d3607ea76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:39.421967 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867b89f-9d7d-4826-8a08-196d3607ea76 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:39.432280 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1431/2840] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:58:39.436515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38134ed1-db50-49af-ab01-229f2d870407 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:39.447861 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38134ed1-db50-49af-ab01-229f2d870407 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:39.453317 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcce9fc-627a-4dec-8272-8a18c12a7764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:39.454488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce9fc-627a-4dec-8272-8a18c12a7764 admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:39.454776 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce9fc-627a-4dec-8272-8a18c12a7764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:39.455054 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce9fc-627a-4dec-8272-8a18c12a7764 admin admin] PATH_INFO: `/v3/projects/bb467769134a4df0bb4608a8283e8dda/users/0bacbe5d174842debcc440335a91659d/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:39.471082 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcce9fc-627a-4dec-8272-8a18c12a7764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb467769134a4df0bb4608a8283e8dda, user_id=0bacbe5d174842debcc440335a91659d, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:39.473803 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcce9fc-627a-4dec-8272-8a18c12a7764 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:39.487357 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1410/2841] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:58:39 2022] PUT /identity/v3/projects/bb467769134a4df0bb4608a8283e8dda/users/0bacbe5d174842debcc440335a91659d/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:58:39.493001 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b73f-b513-49aa-b128-d8762234774b None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:39.493293 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b73f-b513-49aa-b128-d8762234774b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:39.493598 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b73f-b513-49aa-b128-d8762234774b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:39.512635 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-b407b73f-b513-49aa-b128-d8762234774b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:39.513982 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b407b73f-b513-49aa-b128-d8762234774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:39.574486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1432/2842] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:58:39.584429 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcce9fc-627a-4dec-8272-8a18c12a7764 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:39.586212 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0fcce9fc-627a-4dec-8272-8a18c12a7764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:39.646746 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcce9fc-627a-4dec-8272-8a18c12a7764 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:39.650459 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3539717-764d-4e35-bd2e-4b7f66736f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:39.651120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3539717-764d-4e35-bd2e-4b7f66736f3a service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:39.651409 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3539717-764d-4e35-bd2e-4b7f66736f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:39.651694 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3539717-764d-4e35-bd2e-4b7f66736f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:39.662687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3539717-764d-4e35-bd2e-4b7f66736f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:39.664190 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3539717-764d-4e35-bd2e-4b7f66736f3a service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:39.674858 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1411/2843] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:58:43.876292 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1659-e40c-4343-95ba-7f6876045493 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:43.877159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1659-e40c-4343-95ba-7f6876045493 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:43.877444 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1659-e40c-4343-95ba-7f6876045493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:43.907524 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-c24a1659-e40c-4343-95ba-7f6876045493 None None] MFA Rules not processed for user `0bacbe5d174842debcc440335a91659d`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:43.909283 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-c24a1659-e40c-4343-95ba-7f6876045493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:43.988937 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1433/2844] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 18:58:43.995515 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3539717-764d-4e35-bd2e-4b7f66736f3a service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:44.007093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3539717-764d-4e35-bd2e-4b7f66736f3a service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:44.011956 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca2216-fcd0-49d6-af59-e715c0c46d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:44.012625 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2216-fcd0-49d6-af59-e715c0c46d90 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:44.012915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2216-fcd0-49d6-af59-e715c0c46d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:44.013196 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca2216-fcd0-49d6-af59-e715c0c46d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:44.013892 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca2216-fcd0-49d6-af59-e715c0c46d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:44.017258 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca2216-fcd0-49d6-af59-e715c0c46d90 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:44.055896 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1412/2845] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 18:58:43 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:58:44.057172 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a1659-e40c-4343-95ba-7f6876045493 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:44.070659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a1659-e40c-4343-95ba-7f6876045493 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:44.155034 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ae7f-c77e-4521-a21a-4b91d3eb33e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:44.157492 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ae7f-c77e-4521-a21a-4b91d3eb33e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:44.157991 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ae7f-c77e-4521-a21a-4b91d3eb33e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:44.158516 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ae7f-c77e-4521-a21a-4b91d3eb33e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:44.159459 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347ae7f-c77e-4521-a21a-4b91d3eb33e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:44.161434 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347ae7f-c77e-4521-a21a-4b91d3eb33e2 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:44.203901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1434/2846] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 18:58:44 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 18:58:44.208337 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca2216-fcd0-49d6-af59-e715c0c46d90 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:44.224198 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca2216-fcd0-49d6-af59-e715c0c46d90 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:44.229313 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cf2da-6c74-41bd-9de8-27709146996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:44.230120 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cf2da-6c74-41bd-9de8-27709146996b admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:44.230467 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cf2da-6c74-41bd-9de8-27709146996b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:44.230817 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cf2da-6c74-41bd-9de8-27709146996b admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:44.231806 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cf2da-6c74-41bd-9de8-27709146996b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:44.233743 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cf2da-6c74-41bd-9de8-27709146996b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:44.248058 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1413/2847] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:58:44.253321 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ae7f-c77e-4521-a21a-4b91d3eb33e2 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:44.265569 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ae7f-c77e-4521-a21a-4b91d3eb33e2 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:44.271761 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d6475-2dcd-4453-bfc3-4a5a873f9242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:44.272342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d6475-2dcd-4453-bfc3-4a5a873f9242 admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:44.272623 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d6475-2dcd-4453-bfc3-4a5a873f9242 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:44.272901 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d6475-2dcd-4453-bfc3-4a5a873f9242 admin admin] PATH_INFO: `/v3/projects/88353993c3554eb5b4d0c53fc86da615/users/f963716310ce4e9e9af6252a92e2041b/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:44.290057 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d6475-2dcd-4453-bfc3-4a5a873f9242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88353993c3554eb5b4d0c53fc86da615, user_id=f963716310ce4e9e9af6252a92e2041b, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:44.292682 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d6475-2dcd-4453-bfc3-4a5a873f9242 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:44.307980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1435/2848] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:58:44 2022] PUT /identity/v3/projects/88353993c3554eb5b4d0c53fc86da615/users/f963716310ce4e9e9af6252a92e2041b/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:58:44.312486 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cf2da-6c74-41bd-9de8-27709146996b admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:44.323818 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cf2da-6c74-41bd-9de8-27709146996b admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:44.385131 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5f1bb-3cb4-4962-8a77-7c81e2b01b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:44.385993 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5f1bb-3cb4-4962-8a77-7c81e2b01b50 admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:44.386282 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5f1bb-3cb4-4962-8a77-7c81e2b01b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:44.386560 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5f1bb-3cb4-4962-8a77-7c81e2b01b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:44.387335 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5f1bb-3cb4-4962-8a77-7c81e2b01b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:44.388968 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5f1bb-3cb4-4962-8a77-7c81e2b01b50 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:44.400237 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1414/2849] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 18:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 18:58:44.404393 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d6475-2dcd-4453-bfc3-4a5a873f9242 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:44.415617 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d6475-2dcd-4453-bfc3-4a5a873f9242 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:44.420399 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc722e9e-2c3c-4e9c-924e-a633d116c87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:44.422048 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc722e9e-2c3c-4e9c-924e-a633d116c87b admin admin] REQUEST_METHOD: `PUT` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:44.422339 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc722e9e-2c3c-4e9c-924e-a633d116c87b admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:44.422616 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc722e9e-2c3c-4e9c-924e-a633d116c87b admin admin] PATH_INFO: `/v3/projects/88353993c3554eb5b4d0c53fc86da615/users/f963716310ce4e9e9af6252a92e2041b/roles/b104fd2e772843a0974990f965d8b589` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:44.424722 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc722e9e-2c3c-4e9c-924e-a633d116c87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88353993c3554eb5b4d0c53fc86da615, user_id=f963716310ce4e9e9af6252a92e2041b, role_id=b104fd2e772843a0974990f965d8b589)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:44.427440 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc722e9e-2c3c-4e9c-924e-a633d116c87b admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:44.440792 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1436/2850] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 18:58:44 2022] PUT /identity/v3/projects/88353993c3554eb5b4d0c53fc86da615/users/f963716310ce4e9e9af6252a92e2041b/roles/b104fd2e772843a0974990f965d8b589 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 18:58:48.392783 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff67a80-fffa-4ac8-83f7-26635d064ac2 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:48.394256 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff67a80-fffa-4ac8-83f7-26635d064ac2 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:48.394693 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff67a80-fffa-4ac8-83f7-26635d064ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:48.422254 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-0ff67a80-fffa-4ac8-83f7-26635d064ac2 None None] MFA Rules not processed for user `9cb61d5251e74d529a6bfa7d3a684123`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:48.423664 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-0ff67a80-fffa-4ac8-83f7-26635d064ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:48.502084 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1415/2851] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:58:48.545301 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc722e9e-2c3c-4e9c-924e-a633d116c87b admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:48.548520 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-cc722e9e-2c3c-4e9c-924e-a633d116c87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:48.640028 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc722e9e-2c3c-4e9c-924e-a633d116c87b admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:48.649711 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6256f5-ca1d-46f4-8db4-23b928369d16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0e623c10804239a076fc6cde9b198d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:48.651320 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6256f5-ca1d-46f4-8db4-23b928369d16 service glance] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:48.651736 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6256f5-ca1d-46f4-8db4-23b928369d16 service glance] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:48.652260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6256f5-ca1d-46f4-8db4-23b928369d16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:48.654554 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-da6256f5-ca1d-46f4-8db4-23b928369d16 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:48.755065 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6256f5-ca1d-46f4-8db4-23b928369d16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:48.757242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6256f5-ca1d-46f4-8db4-23b928369d16 service glance] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:48.772045 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1437/2852] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:58:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:58:49.145004 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cff4-b8f1-4b77-bf57-b3cbfd4bc66f None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:49.145300 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cff4-b8f1-4b77-bf57-b3cbfd4bc66f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:49.145590 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cff4-b8f1-4b77-bf57-b3cbfd4bc66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:49.177439 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1e40cff4-b8f1-4b77-bf57-b3cbfd4bc66f None None] MFA Rules not processed for user `f963716310ce4e9e9af6252a92e2041b`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:49.181346 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1e40cff4-b8f1-4b77-bf57-b3cbfd4bc66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:49.287675 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1416/2853] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:58:49.304668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6256f5-ca1d-46f4-8db4-23b928369d16 service glance] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:49.321195 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6256f5-ca1d-46f4-8db4-23b928369d16 service glance] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:49.324835 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe957f6-820f-4eb1-985f-9ff3b8bc1b26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f0e623c10804239a076fc6cde9b198d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:49.325500 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe957f6-820f-4eb1-985f-9ff3b8bc1b26 service glance] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:49.325874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe957f6-820f-4eb1-985f-9ff3b8bc1b26 service glance] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:49.326120 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe957f6-820f-4eb1-985f-9ff3b8bc1b26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:49.401305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe957f6-820f-4eb1-985f-9ff3b8bc1b26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:49.402795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe957f6-820f-4eb1-985f-9ff3b8bc1b26 service glance] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:49.414220 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1438/2854] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:58:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:58:49.482250 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40cff4-b8f1-4b77-bf57-b3cbfd4bc66f None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:49.482765 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe957f6-820f-4eb1-985f-9ff3b8bc1b26 service glance] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:49.484305 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-dfe957f6-820f-4eb1-985f-9ff3b8bc1b26 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:49.485165 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1e40cff4-b8f1-4b77-bf57-b3cbfd4bc66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:49.558434 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40cff4-b8f1-4b77-bf57-b3cbfd4bc66f None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:49.563000 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5cf73-e06d-436b-991a-f83c68ec8384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:49.563748 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5cf73-e06d-436b-991a-f83c68ec8384 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:49.564256 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5cf73-e06d-436b-991a-f83c68ec8384 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:49.565162 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5cf73-e06d-436b-991a-f83c68ec8384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:49.566735 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-cae5cf73-e06d-436b-991a-f83c68ec8384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:49.584808 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5cf73-e06d-436b-991a-f83c68ec8384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:49.585449 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe957f6-820f-4eb1-985f-9ff3b8bc1b26 service glance] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:49.586414 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5cf73-e06d-436b-991a-f83c68ec8384 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:49.592316 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64477192-60ed-47dc-b55a-9e43a2fe95b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443fd569cd1b4f6db86d575ed669e26a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:49.593265 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477192-60ed-47dc-b55a-9e43a2fe95b1 service placement] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:49.593545 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477192-60ed-47dc-b55a-9e43a2fe95b1 service placement] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:49.593823 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477192-60ed-47dc-b55a-9e43a2fe95b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:49.602571 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-64477192-60ed-47dc-b55a-9e43a2fe95b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:49.607894 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1417/2855] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:58:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:58:49.610659 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b2d6-58a2-4e71-84ba-7493191ef276 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:49.611160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b2d6-58a2-4e71-84ba-7493191ef276 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:49.611599 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b2d6-58a2-4e71-84ba-7493191ef276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:49.616734 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64477192-60ed-47dc-b55a-9e43a2fe95b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:49.620837 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64477192-60ed-47dc-b55a-9e43a2fe95b1 service placement] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:49.632582 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-85d9b2d6-58a2-4e71-84ba-7493191ef276 None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:49.633007 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1439/2856] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:58:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 18:58:49.635934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-85d9b2d6-58a2-4e71-84ba-7493191ef276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:49.707036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1418/2857] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:58:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:58:49.757484 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64477192-60ed-47dc-b55a-9e43a2fe95b1 service placement] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:49.759099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-64477192-60ed-47dc-b55a-9e43a2fe95b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:49.875615 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64477192-60ed-47dc-b55a-9e43a2fe95b1 service placement] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:49.882595 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d4bf9-6fb2-4271-b908-d2b2f4aa2597 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:49.882811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d4bf9-6fb2-4271-b908-d2b2f4aa2597 service swift] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:49.884164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d4bf9-6fb2-4271-b908-d2b2f4aa2597 service swift] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:49.884164 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d4bf9-6fb2-4271-b908-d2b2f4aa2597 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:49.898342 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d4bf9-6fb2-4271-b908-d2b2f4aa2597 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:49.900452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d4bf9-6fb2-4271-b908-d2b2f4aa2597 service swift] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:49.913083 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1440/2858] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:58:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:58:51.810089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9b2d6-58a2-4e71-84ba-7493191ef276 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:58:51.821093 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9b2d6-58a2-4e71-84ba-7493191ef276 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:58:51.826279 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29df4f-e5ff-4bf2-a7dc-4a2e1fe12bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:58:51.830923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29df4f-e5ff-4bf2-a7dc-4a2e1fe12bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:51.831389 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29df4f-e5ff-4bf2-a7dc-4a2e1fe12bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:51.831872 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29df4f-e5ff-4bf2-a7dc-4a2e1fe12bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:51.834201 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7c29df4f-e5ff-4bf2-a7dc-4a2e1fe12bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:51.847440 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29df4f-e5ff-4bf2-a7dc-4a2e1fe12bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:58:51.849210 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29df4f-e5ff-4bf2-a7dc-4a2e1fe12bb2 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:58:51.858909 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1419/2859] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:58:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:58:59.844707 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb711d8-623c-4f27-8416-50f2aa505939 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:58:59.845228 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb711d8-623c-4f27-8416-50f2aa505939 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:58:59.845379 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb711d8-623c-4f27-8416-50f2aa505939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:58:59.865475 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-5fb711d8-623c-4f27-8416-50f2aa505939 None None] MFA Rules not processed for user `0bacbe5d174842debcc440335a91659d`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:58:59.866715 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-5fb711d8-623c-4f27-8416-50f2aa505939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:58:59.874101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1441/2860] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 18:58:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:59:02.374006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ba553-0cb8-490e-b10f-887f06c5f9dc None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:02.374610 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ba553-0cb8-490e-b10f-887f06c5f9dc None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:02.374722 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ba553-0cb8-490e-b10f-887f06c5f9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:02.394766 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-074ba553-0cb8-490e-b10f-887f06c5f9dc None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 18:59:02.396015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-074ba553-0cb8-490e-b10f-887f06c5f9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:02.417186 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1420/2861] 10.222.0.72 () {58 vars in 1009 bytes} [Mon May 16 18:59:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 18:59:02.434777 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb711d8-623c-4f27-8416-50f2aa505939 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:59:02.450429 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb711d8-623c-4f27-8416-50f2aa505939 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:59:02.457960 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618d43f-85e4-4ddb-9caf-1fa3f1a878e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:59:02.458729 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618d43f-85e4-4ddb-9caf-1fa3f1a878e1 service swift] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:02.459078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618d43f-85e4-4ddb-9caf-1fa3f1a878e1 service swift] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:02.459418 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618d43f-85e4-4ddb-9caf-1fa3f1a878e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:02.470511 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618d43f-85e4-4ddb-9caf-1fa3f1a878e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:59:02.472155 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618d43f-85e4-4ddb-9caf-1fa3f1a878e1 service swift] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:59:02.480855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1442/2862] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 18:59:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 18:59:34.298695 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ba553-0cb8-490e-b10f-887f06c5f9dc None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:59:34.307546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ba553-0cb8-490e-b10f-887f06c5f9dc None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:59:34.314002 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577ab6a-b161-4727-8697-ae718a20c8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:59:34.314759 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577ab6a-b161-4727-8697-ae718a20c8ea service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:34.315100 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577ab6a-b161-4727-8697-ae718a20c8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:34.315431 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577ab6a-b161-4727-8697-ae718a20c8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:34.332099 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577ab6a-b161-4727-8697-ae718a20c8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:59:34.335522 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577ab6a-b161-4727-8697-ae718a20c8ea service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:59:34.348730 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1421/2863] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:59:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:59:36.688251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618d43f-85e4-4ddb-9caf-1fa3f1a878e1 service swift] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:59:36.690588 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-9618d43f-85e4-4ddb-9caf-1fa3f1a878e1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:36.725397 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618d43f-85e4-4ddb-9caf-1fa3f1a878e1 service swift] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:59:36.736450 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f603e-11ca-4b01-8b7e-34489c5824ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:59:36.739317 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f603e-11ca-4b01-8b7e-34489c5824ac service nova] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:36.740144 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f603e-11ca-4b01-8b7e-34489c5824ac service nova] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:36.741581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f603e-11ca-4b01-8b7e-34489c5824ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:36.745036 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7b4f603e-11ca-4b01-8b7e-34489c5824ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:36.771894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f603e-11ca-4b01-8b7e-34489c5824ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:59:36.775118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f603e-11ca-4b01-8b7e-34489c5824ac service nova] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:59:36.791086 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1443/2864] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:59:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 18:59:54.116652 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577ab6a-b161-4727-8697-ae718a20c8ea service neutron] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 18:59:54.118189 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-c577ab6a-b161-4727-8697-ae718a20c8ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:54.134239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577ab6a-b161-4727-8697-ae718a20c8ea service neutron] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 18:59:54.140182 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30c2b8-be93-45c1-972a-0e6e607f7875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc09bfcc0d8c4d20a156b3b08ffafa34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 18:59:54.140853 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30c2b8-be93-45c1-972a-0e6e607f7875 service nova] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 18:59:54.141137 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30c2b8-be93-45c1-972a-0e6e607f7875 service nova] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 18:59:54.141415 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30c2b8-be93-45c1-972a-0e6e607f7875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 18:59:54.143297 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-bd30c2b8-be93-45c1-972a-0e6e607f7875 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 18:59:54.164538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30c2b8-be93-45c1-972a-0e6e607f7875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 18:59:54.164538 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30c2b8-be93-45c1-972a-0e6e607f7875 service nova] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 18:59:54.179036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1422/2865] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 18:59:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:04.778709 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f603e-11ca-4b01-8b7e-34489c5824ac service nova] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:04.780285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-7b4f603e-11ca-4b01-8b7e-34489c5824ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:04.846845 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f603e-11ca-4b01-8b7e-34489c5824ac service nova] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:04.851391 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f33f9-14f2-4584-9154-bc435d956787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:04.852295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f33f9-14f2-4584-9154-bc435d956787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:04.852577 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f33f9-14f2-4584-9154-bc435d956787 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:04.852855 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f33f9-14f2-4584-9154-bc435d956787 admin admin] PATH_INFO: `/v3/users/9cb61d5251e74d529a6bfa7d3a684123` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:04.854074 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f33f9-14f2-4584-9154-bc435d956787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb61d5251e74d529a6bfa7d3a684123)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:04.856651 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f33f9-14f2-4584-9154-bc435d956787 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:04.905940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6e4f33f9-14f2-4584-9154-bc435d956787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb61d5251e74d529a6bfa7d3a684123'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:04.918696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6e4f33f9-14f2-4584-9154-bc435d956787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb61d5251e74d529a6bfa7d3a684123'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:04.919877 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6e4f33f9-14f2-4584-9154-bc435d956787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb61d5251e74d529a6bfa7d3a684123'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:04.927772 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6e4f33f9-14f2-4584-9154-bc435d956787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb61d5251e74d529a6bfa7d3a684123'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:04.936058 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-6e4f33f9-14f2-4584-9154-bc435d956787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb61d5251e74d529a6bfa7d3a684123'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:04.942101 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1444/2866] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 19:00:04 2022] DELETE /identity/v3/users/9cb61d5251e74d529a6bfa7d3a684123 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:00:05.135681 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30c2b8-be93-45c1-972a-0e6e607f7875 service nova] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:05.148655 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30c2b8-be93-45c1-972a-0e6e607f7875 service nova] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:05.213822 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:05.215387 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:05.216302 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:05.216589 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] PATH_INFO: `/v3/projects/9cf09aab60304f30ae52a87b7b1ea81a` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:05.217864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf09aab60304f30ae52a87b7b1ea81a)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:05.220072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:05.267023 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf09aab60304f30ae52a87b7b1ea81a', 'request_id': 'req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:05.273487 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf09aab60304f30ae52a87b7b1ea81a', 'request_id': 'req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:05.281169 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf09aab60304f30ae52a87b7b1ea81a', 'request_id': 'req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:05.292347 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] The token cache is being invalidate because project 9cf09aab60304f30ae52a87b7b1ea81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91825) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:00:05.292635 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:05.293343 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-3bb4ca60-56bb-4f09-8a1a-83468d9495ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:05.294916 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1423/2867] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 19:00:05 2022] DELETE /identity/v3/projects/9cf09aab60304f30ae52a87b7b1ea81a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:00:05.300518 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eabfc5-3629-4159-8d53-83e0f25c3d22 None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:05.301027 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eabfc5-3629-4159-8d53-83e0f25c3d22 None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:05.301306 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eabfc5-3629-4159-8d53-83e0f25c3d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:05.320924 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-b3eabfc5-3629-4159-8d53-83e0f25c3d22 None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:05.321940 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-b3eabfc5-3629-4159-8d53-83e0f25c3d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:05.387380 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1445/2868] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 19:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 19:00:05.394807 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb0764-e793-4e7b-ad01-bfb10a74fd3f None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:05.395160 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb0764-e793-4e7b-ad01-bfb10a74fd3f None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:05.395617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb0764-e793-4e7b-ad01-bfb10a74fd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:05.414716 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-1efb0764-e793-4e7b-ad01-bfb10a74fd3f None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:05.415990 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-1efb0764-e793-4e7b-ad01-bfb10a74fd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:05.427159 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1424/2869] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 19:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:05.434295 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eabfc5-3629-4159-8d53-83e0f25c3d22 None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:05.446242 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eabfc5-3629-4159-8d53-83e0f25c3d22 None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:05.452363 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d09a-ba1f-4667-854e-f9873e435718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:05.453269 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d09a-ba1f-4667-854e-f9873e435718 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:05.454023 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d09a-ba1f-4667-854e-f9873e435718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:05.454362 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d09a-ba1f-4667-854e-f9873e435718 admin admin] PATH_INFO: `/v3/domains` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:05.455452 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d09a-ba1f-4667-854e-f9873e435718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 19:00:05.455810 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d09a-ba1f-4667-854e-f9873e435718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:05.457660 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d09a-ba1f-4667-854e-f9873e435718 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:05.476490 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1446/2870] 10.222.0.72 () {58 vars in 1152 bytes} [Mon May 16 19:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 19:00:05.478021 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb0764-e793-4e7b-ad01-bfb10a74fd3f None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:05.490057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb0764-e793-4e7b-ad01-bfb10a74fd3f None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:05.494900 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b970bd-035a-4c51-8735-2c159f1b93e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:05.495578 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b970bd-035a-4c51-8735-2c159f1b93e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:05.496454 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b970bd-035a-4c51-8735-2c159f1b93e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:05.496738 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b970bd-035a-4c51-8735-2c159f1b93e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:05.497456 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b970bd-035a-4c51-8735-2c159f1b93e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:05.499365 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b970bd-035a-4c51-8735-2c159f1b93e7 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:05.547904 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1425/2871] 10.222.0.72 () {60 vars in 1152 bytes} [Mon May 16 19:00:05 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:00:05.551947 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d09a-ba1f-4667-854e-f9873e435718 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:05.569696 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d09a-ba1f-4667-854e-f9873e435718 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:05.654078 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284c2af-b127-4e53-93b8-bbeca63eec20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:05.655081 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c2af-b127-4e53-93b8-bbeca63eec20 admin admin] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:05.655499 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c2af-b127-4e53-93b8-bbeca63eec20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:05.656039 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c2af-b127-4e53-93b8-bbeca63eec20 admin admin] PATH_INFO: `/v3/users` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:05.656985 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284c2af-b127-4e53-93b8-bbeca63eec20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:05.659425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284c2af-b127-4e53-93b8-bbeca63eec20 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:05.688542 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b970bd-035a-4c51-8735-2c159f1b93e7 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:05.688965 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1447/2872] 10.222.0.72 () {60 vars in 1143 bytes} [Mon May 16 19:00:05 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 19:00:05.699772 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b970bd-035a-4c51-8735-2c159f1b93e7 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:05.705687 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf814c90-4bce-4401-a5a4-976dfe36dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:05.706400 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814c90-4bce-4401-a5a4-976dfe36dc6b admin admin] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:05.706686 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814c90-4bce-4401-a5a4-976dfe36dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:05.706964 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814c90-4bce-4401-a5a4-976dfe36dc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:05.707700 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf814c90-4bce-4401-a5a4-976dfe36dc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:05.709344 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf814c90-4bce-4401-a5a4-976dfe36dc6b admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:05.721398 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1426/2873] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 19:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 19:00:05.726118 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284c2af-b127-4e53-93b8-bbeca63eec20 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:05.736013 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284c2af-b127-4e53-93b8-bbeca63eec20 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:05.740713 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44787e22-5d27-4e66-87f2-96d6884bfca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:05.741378 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44787e22-5d27-4e66-87f2-96d6884bfca8 admin admin] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:05.741659 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44787e22-5d27-4e66-87f2-96d6884bfca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:05.741932 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44787e22-5d27-4e66-87f2-96d6884bfca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:05.742668 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44787e22-5d27-4e66-87f2-96d6884bfca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:05.744290 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44787e22-5d27-4e66-87f2-96d6884bfca8 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:05.755326 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1448/2874] 10.222.0.72 () {58 vars in 1121 bytes} [Mon May 16 19:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 19:00:05.760864 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf814c90-4bce-4401-a5a4-976dfe36dc6b admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:05.772324 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf814c90-4bce-4401-a5a4-976dfe36dc6b admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:05.777752 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c67fd-ac4b-4451-b834-9bc5b090f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:05.778671 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c67fd-ac4b-4451-b834-9bc5b090f1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:05.778954 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c67fd-ac4b-4451-b834-9bc5b090f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:05.779235 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c67fd-ac4b-4451-b834-9bc5b090f1fc admin admin] PATH_INFO: `/v3/projects/62e5eb51b7c546a49766c7be724046fd/users/7b0166f27109400ba137dc64aaea4567/roles/627af591fe55445c83abe50f753404c9` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:05.802594 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c67fd-ac4b-4451-b834-9bc5b090f1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e5eb51b7c546a49766c7be724046fd, user_id=7b0166f27109400ba137dc64aaea4567, role_id=627af591fe55445c83abe50f753404c9)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:05.808089 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c67fd-ac4b-4451-b834-9bc5b090f1fc admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:05.827546 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1427/2875] 10.222.0.72 () {60 vars in 1482 bytes} [Mon May 16 19:00:05 2022] PUT /identity/v3/projects/62e5eb51b7c546a49766c7be724046fd/users/7b0166f27109400ba137dc64aaea4567/roles/627af591fe55445c83abe50f753404c9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:00:05.840405 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26674562-892d-493d-b2ba-6544ee2b34ff None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:05.841287 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26674562-892d-493d-b2ba-6544ee2b34ff None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:05.841480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26674562-892d-493d-b2ba-6544ee2b34ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:05.874009 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-26674562-892d-493d-b2ba-6544ee2b34ff None None] MFA Rules not processed for user `7b0166f27109400ba137dc64aaea4567`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:05.875304 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-26674562-892d-493d-b2ba-6544ee2b34ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:05.949243 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1449/2876] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 19:00:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:05.960340 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c67fd-ac4b-4451-b834-9bc5b090f1fc admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:05.962062 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f72c67fd-ac4b-4451-b834-9bc5b090f1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:06.023667 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c67fd-ac4b-4451-b834-9bc5b090f1fc admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:06.027870 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99f9c0-58b6-4726-9462-bbeb5b5ebee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb06ac74276c4238b178a2467013348c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:06.028502 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99f9c0-58b6-4726-9462-bbeb5b5ebee3 service cinder] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:06.028784 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99f9c0-58b6-4726-9462-bbeb5b5ebee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:06.029064 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99f9c0-58b6-4726-9462-bbeb5b5ebee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:06.039238 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99f9c0-58b6-4726-9462-bbeb5b5ebee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:06.041452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99f9c0-58b6-4726-9462-bbeb5b5ebee3 service cinder] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:06.056015 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1428/2877] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 19:00:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:06.953713 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26674562-892d-493d-b2ba-6544ee2b34ff None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:06.955159 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-26674562-892d-493d-b2ba-6544ee2b34ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:07.013670 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26674562-892d-493d-b2ba-6544ee2b34ff None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:07.017332 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbde55-f014-4fe2-bcd0-f311bf0fd576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:07.017980 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbde55-f014-4fe2-bcd0-f311bf0fd576 service neutron] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:07.018256 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbde55-f014-4fe2-bcd0-f311bf0fd576 service neutron] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:07.018534 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbde55-f014-4fe2-bcd0-f311bf0fd576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:07.020743 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-cbbbde55-f014-4fe2-bcd0-f311bf0fd576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:07.085874 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbde55-f014-4fe2-bcd0-f311bf0fd576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:07.087223 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbde55-f014-4fe2-bcd0-f311bf0fd576 service neutron] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:07.097640 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1450/2878] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 19:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:13.779157 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99f9c0-58b6-4726-9462-bbeb5b5ebee3 service cinder] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:13.780778 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-fd99f9c0-58b6-4726-9462-bbeb5b5ebee3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:13.795488 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99f9c0-58b6-4726-9462-bbeb5b5ebee3 service cinder] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:13.800386 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:13.801903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:13.801903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:13.801903 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] PATH_INFO: `/v3/users/5e9ebfaac4984817bb768476ef74445c` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:13.803044 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9ebfaac4984817bb768476ef74445c)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:13.805047 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:13.856944 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9ebfaac4984817bb768476ef74445c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:13.868650 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9ebfaac4984817bb768476ef74445c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:13.869388 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9ebfaac4984817bb768476ef74445c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:13.870006 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9ebfaac4984817bb768476ef74445c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:13.881269 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9ebfaac4984817bb768476ef74445c'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:13.896450 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1429/2879] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 19:00:13 2022] DELETE /identity/v3/users/5e9ebfaac4984817bb768476ef74445c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:00:14.086486 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbde55-f014-4fe2-bcd0-f311bf0fd576 service neutron] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:14.098678 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbde55-f014-4fe2-bcd0-f311bf0fd576 service neutron] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:14.178157 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:14.179368 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:14.179642 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:14.179961 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] PATH_INFO: `/v3/projects/5b168bfd42a645269b47c98f4210e4aa` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:14.181229 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b168bfd42a645269b47c98f4210e4aa)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:14.183543 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:14.237813 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b168bfd42a645269b47c98f4210e4aa', 'request_id': 'req-aab3aae4-a89e-4da4-af44-bd2dbca3b269'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.246488 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b168bfd42a645269b47c98f4210e4aa', 'request_id': 'req-aab3aae4-a89e-4da4-af44-bd2dbca3b269'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.258260 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b168bfd42a645269b47c98f4210e4aa', 'request_id': 'req-aab3aae4-a89e-4da4-af44-bd2dbca3b269'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.272191 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] The token cache is being invalidate because project 5b168bfd42a645269b47c98f4210e4aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:00:14.272495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.273166 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.275105 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1451/2880] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 19:00:14 2022] DELETE /identity/v3/projects/5b168bfd42a645269b47c98f4210e4aa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:00:14.283452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:14.284932 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:14.298575 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bed67-9ba3-4d04-b5fc-3c1ec1d5aa48 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:14.356104 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:14.357001 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:14.357287 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:14.357568 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] PATH_INFO: `/v3/users/a7f186a204be4043b7179f90a6957e51` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:14.358835 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f186a204be4043b7179f90a6957e51)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:14.360978 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:14.408668 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f186a204be4043b7179f90a6957e51'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.420452 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f186a204be4043b7179f90a6957e51'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.421248 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f186a204be4043b7179f90a6957e51'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.421854 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f186a204be4043b7179f90a6957e51'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.429482 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f186a204be4043b7179f90a6957e51'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.442095 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1430/2881] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 19:00:14 2022] DELETE /identity/v3/users/a7f186a204be4043b7179f90a6957e51 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:00:14.622442 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:14.624084 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:14.638311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3aae4-a89e-4da4-af44-bd2dbca3b269 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:14.697237 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:14.698143 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:14.698422 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:14.698778 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] PATH_INFO: `/v3/projects/180f3443a6cc4812925d74f53babf199` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:14.700060 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=180f3443a6cc4812925d74f53babf199)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:14.701963 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:14.749819 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180f3443a6cc4812925d74f53babf199', 'request_id': 'req-74ada489-d825-4c26-b893-7045236c9e83'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.756288 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180f3443a6cc4812925d74f53babf199', 'request_id': 'req-74ada489-d825-4c26-b893-7045236c9e83'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.764149 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180f3443a6cc4812925d74f53babf199', 'request_id': 'req-74ada489-d825-4c26-b893-7045236c9e83'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.774680 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] The token cache is being invalidate because project 180f3443a6cc4812925d74f53babf199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:00:14.774970 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.775650 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-74ada489-d825-4c26-b893-7045236c9e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:14.777431 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1452/2882] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 19:00:14 2022] DELETE /identity/v3/projects/180f3443a6cc4812925d74f53babf199 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:00:24.593516 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:24.595072 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:24.609933 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92979c2e-452e-4d44-871a-73cdf8275557 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:24.666207 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:24.667604 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:24.667915 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:24.668202 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] PATH_INFO: `/v3/users/7b0166f27109400ba137dc64aaea4567` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:24.669383 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0166f27109400ba137dc64aaea4567)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:24.671293 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:24.717276 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0166f27109400ba137dc64aaea4567'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:24.728373 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0166f27109400ba137dc64aaea4567'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:24.729037 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0166f27109400ba137dc64aaea4567'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:24.730308 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0166f27109400ba137dc64aaea4567'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:24.737328 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0166f27109400ba137dc64aaea4567'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:24.749263 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1431/2883] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 19:00:24 2022] DELETE /identity/v3/users/7b0166f27109400ba137dc64aaea4567 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:00:24.753773 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8595-8789-4ac9-8a64-27d47b64938b None None] REQUEST_METHOD: `POST` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:24.754285 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8595-8789-4ac9-8a64-27d47b64938b None None] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:24.754396 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8595-8789-4ac9-8a64-27d47b64938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:24.771560 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.auth.core [None req-3d2a8595-8789-4ac9-8a64-27d47b64938b None None] MFA Rules not processed for user `bf98c9865904466fa1a6dd87c28d438c`. Rule list: `[]` (Enabled: `True`). {{(pid=91826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:00:24.772785 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3d2a8595-8789-4ac9-8a64-27d47b64938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:24.834720 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1453/2884] 10.222.0.72 () {58 vars in 957 bytes} [Mon May 16 19:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:00:24.845348 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:24.846632 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:24.905934 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bc98f-d1c8-4262-b156-c16003c042e5 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:24.913229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc5159-9296-40f2-95be-a30ead2c3e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c22a0fc8a3914f7fb3356a84827db326', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:24.913229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc5159-9296-40f2-95be-a30ead2c3e11 service neutron] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:24.913229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc5159-9296-40f2-95be-a30ead2c3e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:24.913229 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc5159-9296-40f2-95be-a30ead2c3e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:24.924394 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc5159-9296-40f2-95be-a30ead2c3e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:24.926370 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc5159-9296-40f2-95be-a30ead2c3e11 service neutron] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:24.936557 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1432/2885] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 19:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 19:00:25.225578 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a8595-8789-4ac9-8a64-27d47b64938b None None] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:00:25.227055 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-3d2a8595-8789-4ac9-8a64-27d47b64938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:00:25.239005 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a8595-8789-4ac9-8a64-27d47b64938b None None] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:00:25.243738 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:00:25.244607 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:00:25.244882 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:00:25.245495 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] PATH_INFO: `/v3/projects/62e5eb51b7c546a49766c7be724046fd` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:00:25.246694 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e5eb51b7c546a49766c7be724046fd)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:00:25.248658 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:00:25.296996 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e5eb51b7c546a49766c7be724046fd', 'request_id': 'req-1e5b04a1-d769-460b-9b9b-659b67bb5b74'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:25.303263 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e5eb51b7c546a49766c7be724046fd', 'request_id': 'req-1e5b04a1-d769-460b-9b9b-659b67bb5b74'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:25.310325 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e5eb51b7c546a49766c7be724046fd', 'request_id': 'req-1e5b04a1-d769-460b-9b9b-659b67bb5b74'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:25.320349 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] The token cache is being invalidate because project 62e5eb51b7c546a49766c7be724046fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:00:25.320632 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:25.321251 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:00:25.322795 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1454/2886] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 19:00:25 2022] DELETE /identity/v3/projects/62e5eb51b7c546a49766c7be724046fd => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:01:18.073299 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1ca8-b950-4e48-9b83-78ce7c4d6019 None None] REQUEST_METHOD: `POST` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:18.074080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1ca8-b950-4e48-9b83-78ce7c4d6019 None None] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:18.074080 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1ca8-b950-4e48-9b83-78ce7c4d6019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:18.100858 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.auth.core [None req-724c1ca8-b950-4e48-9b83-78ce7c4d6019 None None] MFA Rules not processed for user `213dd48e9a5d46dda298caf8cbffce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91825) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 19:01:18.102067 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-724c1ca8-b950-4e48-9b83-78ce7c4d6019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:18.173634 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1433/2887] 10.222.0.72 () {58 vars in 967 bytes} [Mon May 16 19:01:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 19:01:18.212674 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:18.214867 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:18.308115 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b04a1-d769-460b-9b9b-659b67bb5b74 admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:18.313214 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bba1fa-f038-498a-92b2-6ebefd3fc7d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55231d7b40cb4479b9a6580a0f0b7cb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:18.313859 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bba1fa-f038-498a-92b2-6ebefd3fc7d6 service swift] REQUEST_METHOD: `GET` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:18.314140 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bba1fa-f038-498a-92b2-6ebefd3fc7d6 service swift] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:18.314414 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bba1fa-f038-498a-92b2-6ebefd3fc7d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:18.322308 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bba1fa-f038-498a-92b2-6ebefd3fc7d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:18.324692 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bba1fa-f038-498a-92b2-6ebefd3fc7d6 service swift] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:18.332501 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1455/2888] 10.222.0.72 () {60 vars in 1384 bytes} [Mon May 16 19:01:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 19:01:24.544052 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c1ca8-b950-4e48-9b83-78ce7c4d6019 None None] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:24.545570 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-724c1ca8-b950-4e48-9b83-78ce7c4d6019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:24.640821 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c1ca8-b950-4e48-9b83-78ce7c4d6019 None None] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:24.645397 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:24.646261 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:24.646547 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:24.646823 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] PATH_INFO: `/v3/users/0bacbe5d174842debcc440335a91659d` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:24.648036 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bacbe5d174842debcc440335a91659d)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:24.649986 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:24.694405 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bacbe5d174842debcc440335a91659d'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:24.706353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bacbe5d174842debcc440335a91659d'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:24.707029 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bacbe5d174842debcc440335a91659d'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:24.707641 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bacbe5d174842debcc440335a91659d'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:24.715155 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bacbe5d174842debcc440335a91659d'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:24.726836 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1434/2889] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 19:01:24 2022] DELETE /identity/v3/users/0bacbe5d174842debcc440335a91659d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:01:24.896894 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bba1fa-f038-498a-92b2-6ebefd3fc7d6 service swift] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:24.908565 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bba1fa-f038-498a-92b2-6ebefd3fc7d6 service swift] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:24.968812 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:24.969677 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:24.969962 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:24.970239 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] PATH_INFO: `/v3/projects/bb467769134a4df0bb4608a8283e8dda` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:24.971604 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb467769134a4df0bb4608a8283e8dda)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:24.973546 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:25.018099 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb467769134a4df0bb4608a8283e8dda', 'request_id': 'req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.024031 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb467769134a4df0bb4608a8283e8dda', 'request_id': 'req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.031856 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb467769134a4df0bb4608a8283e8dda', 'request_id': 'req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.041609 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] The token cache is being invalidate because project bb467769134a4df0bb4608a8283e8dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:01:25.042581 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.043253 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.044830 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1456/2890] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 19:01:24 2022] DELETE /identity/v3/projects/bb467769134a4df0bb4608a8283e8dda => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:01:25.048847 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:25.050239 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:25.063837 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3ec8-e9ec-4aa5-9c6b-4349dd77235f admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:25.118453 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:25.119330 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:25.119617 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:25.120550 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] PATH_INFO: `/v3/users/f963716310ce4e9e9af6252a92e2041b` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:25.121921 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f963716310ce4e9e9af6252a92e2041b)` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:25.123923 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:25.168025 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f963716310ce4e9e9af6252a92e2041b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.179353 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f963716310ce4e9e9af6252a92e2041b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.180076 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f963716310ce4e9e9af6252a92e2041b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.180701 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f963716310ce4e9e9af6252a92e2041b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.189653 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.notifications [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f963716310ce4e9e9af6252a92e2041b'} {{(pid=91825) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.201477 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1435/2891] 10.222.0.72 () {58 vars in 1223 bytes} [Mon May 16 19:01:25 2022] DELETE /identity/v3/users/f963716310ce4e9e9af6252a92e2041b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 19:01:25.369428 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] Authenticating user token {{(pid=91826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:25.371480 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.fernet_utils [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:25.384096 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbccb8-fb4e-4869-b8a4-c0b07522cffa admin admin] Validating token access rules against request {{(pid=91826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:25.442750 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf98c9865904466fa1a6dd87c28d438c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44adac522ccb43149dbafba14f75fd72', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:25.443636 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:25.443948 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:25.444222 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] PATH_INFO: `/v3/projects/88353993c3554eb5b4d0c53fc86da615` {{(pid=91826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:25.445441 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88353993c3554eb5b4d0c53fc86da615)` {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:25.447311 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] RBAC: Authorization granted {{(pid=91826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:25.496788 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88353993c3554eb5b4d0c53fc86da615', 'request_id': 'req-26c6f540-c065-4f22-aee8-839623e38958'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.502797 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88353993c3554eb5b4d0c53fc86da615', 'request_id': 'req-26c6f540-c065-4f22-aee8-839623e38958'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.510572 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88353993c3554eb5b4d0c53fc86da615', 'request_id': 'req-26c6f540-c065-4f22-aee8-839623e38958'} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.520527 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] The token cache is being invalidate because project 88353993c3554eb5b4d0c53fc86da615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 19:01:25.520811 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.521425 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: DEBUG keystone.notifications [None req-26c6f540-c065-4f22-aee8-839623e38958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 19:01:25.522969 dv-cinder-750782-22-iscsi devstack@keystone.service[91826]: [pid: 91826|app: 0|req: 1457/2892] 10.222.0.72 () {58 vars in 1232 bytes} [Mon May 16 19:01:25 2022] DELETE /identity/v3/projects/88353993c3554eb5b4d0c53fc86da615 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 19:01:45.427931 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] Authenticating user token {{(pid=91825) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 19:01:45.429399 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:45.533069 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41d42e-2bb9-4143-8476-afb64a48b9b1 admin admin] Validating token access rules against request {{(pid=91825) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 19:01:45.592926 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035601f5-5292-4775-993a-e95a471f3823 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '443fd569cd1b4f6db86d575ed669e26a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f8c8b57010645c6919f27faff7ede89', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91825) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 19:01:45.593643 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035601f5-5292-4775-993a-e95a471f3823 service placement] REQUEST_METHOD: `GET` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 19:01:45.594016 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035601f5-5292-4775-993a-e95a471f3823 service placement] SCRIPT_NAME: `/identity` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 19:01:45.594284 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035601f5-5292-4775-993a-e95a471f3823 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91825) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 19:01:45.596181 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.fernet_utils [None req-035601f5-5292-4775-993a-e95a471f3823 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91825) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 19:01:45.608475 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035601f5-5292-4775-993a-e95a471f3823 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 19:01:45.610057 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035601f5-5292-4775-993a-e95a471f3823 service placement] RBAC: Authorization granted {{(pid=91825) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 19:01:45.621257 dv-cinder-750782-22-iscsi devstack@keystone.service[91825]: [pid: 91825|app: 0|req: 1436/2893] 10.222.0.72 () {60 vars in 1365 bytes} [Mon May 16 19:01:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0)